Fork me on GitHub
#datomic
<
2020-04-05
>
Braden Shepherdson04:04:26

Is the embedded storage in Datomic Free sufficient for a small website I'm building for a hobby group? The old one it's replacing is a single VPS with PHP scripts and MySQL, but there are perhaps 130,000 rows in the database, maybe a million datoms. The transaction rate is modest though, maybe a couple hundred an hour at most. There's just no context for what it's capable of.

John Leidegren06:04:58

So, it's based on the H2 Database Engine and noting in Datomic is inherently slow. The way it uses the database is that it pulls segments of data from the database, so you don't have a datom to row mapping or anything like that. You basically use the database as a key value store. 130,000 rows doesn't sound like a lot and a couple of hundred transactions an hour also seem small. I haven't done this myself but I don't think you will have any problems.

Braden Shepherdson12:04:11

Okay, I'll give it a try. I know it's a small database, but I was worried because it's also the "dev" version. I could imagine a very naive dev version that just writes chunks of EDN to files and can only handle a free thousand datoms, or has to fully read into memory, or similar.

Braden Shepherdson12:04:31

But it sounds like it's the other way around, and the dev version uses the capable though modest free version's embedded storage.

John Leidegren14:04:58

Yes, I know for a fact that it does! The storage layer is just insert or update of KV pairs that contains chunks of datoms for either log och index data.

John Leidegren14:04:46

Depending on the I/O subsystem of the box that is running the thing, it should be plenty capable. I have no direct experience with H2 but it probably performs well enough and it's not asked to do anything other than shuffling bytes back and forth. So, it's a quite ideal situation.

favila17:04:53

The real perf limitation is that the dev transactor process is also the storage process (it opens another port to serve peers’ sql queries)

favila17:04:30

I don’t know how well optimized that server code is

favila17:04:02

But I have used shared dev for light duty just fine; also as the target of large bulk import jobs just fine

hadils21:04:46

Datomic Cloud Question: Is there a "hook" for starting up processes when the Ions are started, e.g., after a deploy? I want to use Quartzite and don't know the best way to initialize it...Thanks in advance.