Fork me on GitHub
#datahike
<
2022-05-13
>
phronmophobic00:05:37

I've seen some hints that indicate the :file backend isn't the recommended storage backend. Does anyone recommend any particular backend? Ideally, I'd like to use an embedded db that doesn't require an external db process (eg. maybe h2 or sqlite)?

awb9902:05:58

Good question. I would like to know about this as well :-) I run a mini database with datahike file backend. I have the same logic also with mongo db and on mongodb everything is much faster. This is weird since with mongodb there is an additional encoding layer involved. My worst experience with file store so far is fragmentation that occurs over time db size grows x 10000 due to updates in data, even with history disabled. My writes are slow ( I have lots of small transactions that I could rewrite to be way fewer). So the question of other backends is a very important decision.

kkuehne10:05:13

Hey, yeah we're currently trying to get the synchronous interface back into Datahike and after that we would like to add new backends as well since some of the protocols needs to be adjusted. We had the idea to include RocksDB and H2. Would that be of interest?

kkuehne10:05:10

Regarding the performance we're moving away from the hitchhiker-tree to the persistent set since the performance problems with upserts are limiting the transaction times.