This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2023-05-24
Channels
- # aleph (1)
- # beginners (43)
- # calva (22)
- # cider (51)
- # clerk (1)
- # clj-kondo (20)
- # clojure (29)
- # clojure-denmark (1)
- # clojure-europe (73)
- # clojure-finland (28)
- # clojure-nl (1)
- # clojure-norway (7)
- # clojure-spec (7)
- # clojure-uk (4)
- # clojurescript (12)
- # data-science (2)
- # datomic (51)
- # events (1)
- # fulcro (20)
- # hyperfiddle (28)
- # integrant (6)
- # malli (20)
- # matrix (2)
- # music (1)
- # off-topic (66)
- # reitit (17)
- # releases (5)
- # ring (1)
- # shadow-cljs (31)
- # xtdb (6)
I was playing around with XTDB 2 and wanted to check if it is currently not possible to use some storage system to store the XTDB documents. Is it only in-memory right now? I know that XTDB 2 is still under development, so I understand if this is not yet possible. However, if it is possible, I would be interested in learning more about how to do it.
Hey @U04DDKZJERF 👋 We do have initial implementations for a single-node filesystem tx-log/object store, as well as multi-node Kafka and AWS S3 adapters, although these are quite primitive at the moment.
I just found you message in the discuss. Trying out that right now to store the data and work on it. Your message for using local storage: https://discuss.xtdb.com/t/rocksdb-backend-for-v2/208
I don't think we have much documentation on those as yet, but as a quick guide:
• you can specify a local directory tx-log by adding this to your config: {:xtdb.log/local-directory-log {:root-path "/path/to/log/dir"}
• a local directory object-store with {:xtdb.object-store/file-system-object-store {:root-path "/path/to/obj-store/dir"}}
(excuse the inconsistent naming here, this'll likely change)
• a Kafka tx-log with {:xtdb.kafka/log {:bootstrap-servers "localhost:9092", :topic-name "my-topic"}}
• an S3 object-store with {:xtdb.s3/object-store {:bucket "my-bucket"}}