This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2023-02-17
Channels
- # announcements (12)
- # babashka (27)
- # beginners (65)
- # biff (8)
- # calva (22)
- # clj-kondo (1)
- # clj-otel (5)
- # clojure (65)
- # clojure-europe (127)
- # clojure-nl (1)
- # clojure-norway (11)
- # clojure-portugal (2)
- # clojure-uk (2)
- # clojurescript (18)
- # cursive (5)
- # data-science (3)
- # datahike (14)
- # datascript (3)
- # datomic (7)
- # deps-new (11)
- # emacs (31)
- # exercism (1)
- # fulcro (1)
- # honeysql (3)
- # hyperfiddle (38)
- # introduce-yourself (4)
- # leiningen (2)
- # malli (20)
- # meander (2)
- # missionary (3)
- # off-topic (4)
- # pathom (3)
- # practicalli (2)
- # reagent (5)
- # releases (1)
- # sci (1)
- # shadow-cljs (9)
- # xtdb (8)
For a read heavy use case, which one is more preferable, RocksDB or LMDB. Can anyone help me regarding this dilemma.
If I remember correctly, LMDB should be faster… but I don’t know if such a blanket statement is applicable and in what scenarios
Sure will try that. Thank you.
What I personally gathered so far: LMDB is more optimized for reads rather than writes. RocksDB is more optimized for mutations/writes. As with anything performance related there is of course always a big "it depends". You'd have to measure and compare. Secondly. if I remember correctly, it is not safe to backup/copy a RocksDB db while it's running, but it might be with LMDB. Haven't tested that though. And I couldn't find the reference that I read in a hurry.
> LMDB is more optimized for reads rather than writes. > RocksDB is more optimized for mutations/writes. This definitely the case. Our own benchmarking will often show up to 3x faster queries with LMDB > it is not safe to backup/copy a RocksDB db while it's running, but it might be with LMDB as @tatus mentioned, XT's https://docs.xtdb.com/administration/checkpointing/ system is able to take copies of both stores while running, and it accomplishes this using their respective APIs for doing so, see https://github.com/xtdb/xtdb/blob/a231be4c4bfabb5ec75552be074bb056827551e8/modules/lmdb/src/xtdb/lmdb.clj#L133 and https://github.com/xtdb/xtdb/blob/a231be4c4bfabb5ec75552be074bb056827551e8/modules/rocksdb/src/xtdb/rocksdb.clj#L251