JUXT Blog - Crux 'Oumuamua Assignment: Evict Transactions

Introduction

This is the evict installment of the Crux tutorial.

We shall assume you have a Crux standalone node set up locally and are now comfortable with put operations and basic datalog queries. If this is not the case, you can find all you need to know on Earth, Pluto and Mercury. Click on a destination above to take you there.

Arrival

You arrive at the comet 'Oumuamua and pull along side, asking for permission to land. A voice comes over the communications system

How did you find us? Who sent you??

— Mysterious person

Choose your path:

"Kaarlang sent me"

"I’m not sure how I got here, I found you by mistake"

You have permission to land

You are sent away. You must return to Jupiter and find Kaarlang.

Space Port

You land on the space port and are ushered inside. The ships captain, Ilex, greets you.

Hello, it’s good to have you with us.

We are set to leave the solar system right away and as part of our service we offer people the right to be forgotten. Some are not worried that their information is kept here, however others want there to be no personal data left behind.

You may not have been told this yet, but this comet is actually a transportation vessel. It will take us to the star system Gilese 667C which is home to intelligent life far superior to our own. We all are hoping to find opportunities beyond our wildest dreams. All records of this transportation vessel and any life outside of the solar system are heavily monitored and wiped in the interest of preserving the normal technological advancement of the Human race. This means we know little of the beings we are going to meet.

Our task for you is to remove the records of the people who have chosen to be forgotten here.

— Ilex
Captain

You are excited by the prospect and agree to help. First you read the manual entry for evict as this will be the perfect tool.

There are only four transaction operations in Crux: put, delete, match and evict.

Transaction Description

put

Writes a version of a document

delete

Deletes a version of a document

match

Stops a transaction if the precondition is not met.

evict

Removes a document entirely

Evict:

Crux supports eviction of active and historical data to assist with technical compliance for information privacy regulations.

The main transaction log contains only hashes and is immutable. All document content is stored in a dedicated document log that can be evicted by compaction.

A complete evict transaction has the form:

[:crux.tx/evict eid]

Transaction	Description
`put`	Writes a version of a document
`delete`	Deletes a version of a document
`match`	Stops a transaction if the precondition is not met.
`evict`	Removes a document entirely

— Crux manual
Read More

You are given the data for the people on the ship and sync up your Crux node. You decide that you are going to embark on this adventure along with them so you add your name to the list.

(crux/submit-tx node
                [[:crux.tx/put
                  {:crux.db/id :person/kaarlang
                   :full-name "Kaarlang"
                   :origin-planet "Mars"
                   :identity-tag :KA01299242093
                   :DOB #inst "2040-11-23"}]

                 [:crux.tx/put
                  {:crux.db/id :person/ilex
                   :full-name "Ilex Jefferson"
                   :origin-planet "Venus"
                   :identity-tag :IJ01222212454
                   :DOB #inst "2061-02-17"}]

                 [:crux.tx/put
                  {:crux.db/id :person/thadd
                   :full-name "Thad Christover"
                   :origin-moon "Titan"
                   :identity-tag :IJ01222212454
                   :DOB #inst "2101-01-01"}]

                 [:crux.tx/put
                  {:crux.db/id :person/johanna
                   :full-name "Johanna"
                   :origin-planet "Earth"
                   :identity-tag :JA012992129120
                   :DOB #inst "2090-12-07"}]])
;;=> #:crux.tx{:tx-id 0, :tx-time #inst "2020-06-18T16:11:03.410-00:00"}

Before you start the eviction process you make a query function so you can see the full results of anything stored in Crux:

(defn full-query
  [node]
  (crux/q
   (crux/db node)
   '{:find [id]
     :where [[e :crux.db/id id]]
     :full-results? true}))

You show the others the result:

(full-query node)
#_#_
=> #{[{:crux.db/id :person/ilex,
    :full-name "Ilex Jefferson",
    :origin-planet "Venus",
    :identity-tag :IJ01222212454,
    :DOB #inst "2061-02-17T00:00:00.000-00:00"}]
  [{:crux.db/id :person/thadd,
    :full-name "Thad Christover",
    :origin-moon "Titan",
    :identity-tag :IJ01222212454,
    :DOB #inst "2101-01-01T00:00:00.000-00:00"}]
  [{:crux.db/id :person/kaarlang,
    :full-name "Kaarlang",
    :origin-planet "Mars",
    :identity-tag :KA01299242093,
    :DOB #inst "2040-11-23T00:00:00.000-00:00"}]
  [{:crux.db/id :person/johanna,
    :full-name "Johanna",
    :origin-planet "Earth",
    :identity-tag :JA012992129120,
    :DOB #inst "2090-12-07T00:00:00.000-00:00"}]}

The Crux manual said that the evict operation will remove a document entirely. Ilex tells you the only person who whishes to exercise their right to be forgotten is Kaarlang.

(crux/submit-tx node [[:crux.tx/evict :person/kaarlang]])
;;=> #:crux.tx{:tx-id 3, :tx-time #inst "2020-06-18T16:13:03.276-00:00"}

You use your function and see that the transaction was a success.

(full-query node)
#_#_
=> #{[{:crux.db/id :person/ilex,
       :full-name "Ilex Jefferson",
       :origin-planet "Venus",
       :identity-tag :IJ01222212454,
       :DOB #inst "2061-02-17T00:00:00.000-00:00"}]
     [{:crux.db/id :person/thadd,
       :full-name "Thad Christover",
       :origin-moon "Titan",
       :identity-tag :IJ01222212454,
       :DOB #inst "2101-01-01T00:00:00.000-00:00"}]
     [{:crux.db/id :person/johanna,
       :full-name "Johanna",
       :origin-planet "Earth",
       :identity-tag :JA012992129120,
       :DOB #inst "2090-12-07T00:00:00.000-00:00"}]}

All the data associated with the specified :crux.db/id has been removed from the Crux along with the eid itself.

The transaction history is immutable. This means the transactions will never be removed. You assure Ilex that the documents are completely removed from Crux, you can show this by looking at the history for

(crux/entity-history
 (crux/db node)
 :person/kaarlang
 :desc
 {:with-docs? true})
#_#_
=> [{:crux.tx/tx-time #inst "2020-06-18T16:11:03.410-00:00",
     :crux.tx/tx-id 2,
     :crux.db/valid-time #inst "2020-06-18T16:11:03.410-00:00",
     :crux.db/content-hash #crux/id "c3ad3191fff06083fedf3640b625566c02033a6b",
     :crux.db/doc
     #:crux.db{:id #crux/id "efe634523d6867a3c6e4089074adf29b07b45f43",
               :evicted? true}}]

You show the results to Kaarlang who is happy that there his details are no longer a part of the ships logs.

Departure

The ship starts to shake as the engines are fired up.

Ilex thanks you and takes you to the Cryogenics department. You must be put into stasis as the journey will take around 25 years, even at the near light speeds of the ship.

You are astonished with the amount that you have done in one short week. How did little old you end up with an opportunity as big as this?

Your eyes get heavy as the cryogenicist initiates the hibernation process. As they do, you wonder if you’ll ever come back to the solar system.

This is not The End

I hope you enjoyed learning about the basics of Crux. Although this is the final installment for the main tutorial series it is not the end of the Crux tutorial. Watch this space for more tutorial releases of the tutorial where you will be sent on assignments to solve more specific and complex tasks using Crux.

I’d love to hear any ideas for enhancements so don’t hesitate to get in touch.

Crux 'Oumuamua Assignment: Evict Transactions

Johanna Antonelli