Fork me on GitHub
#datomic
<
2023-01-18
>
Leaf Garland22:01:29

We are using Datomic on-prem, and run the backups frequently so that we have many points in time to pick and restore from. We are considering running the backups as frequently as possible (in a loop essentially), and wondered what backup frequency others are using and if anyone knows of reasons we shouldn't.

favila22:01:36

We run the backup in a loop; but eventually the backups get too big (there’s no way to remove a backup point and GC the segments it uses that nothing else uses). So we do a full backup weekly, and while the full backup is running (because it takes a few hours) the incremental backup is also running (so we don’t have gaps).

Leaf Garland22:01:48

Ahh, that's a really good point, and one I hadn't thought too much about as our backups are currently tiny. Thanks.

Joe Lane23:01:50

What’s your ideal retention policy? 1day, 7days, 30days etc?

Leaf Garland02:01:12

Heh, thinking about retention policy when dealing with an immutable database feels odd. I think that 2-4 weeks of high-frequency incremental backups should cover us. With longer term backups that we keep for as long as possible. I could look at running multiple backups at different frequencies of incremental backup? eg. 1 backup on loop that is reset every month, and then another that only runs every week that we archive and reset yearly, etc.