Clojurians Log v2
Clojure programming
Channels
Apps
datomic
2026-02-09T15:59:19.969829Z
Hi, We have an internal support application in the company, to help track what is going on. It has about 3M users, each having about 20 properties and for each users a number of document, totalling 55M, each having about 20 properties. The current db, backed up by Postgres is 400GB, and we still have about 2M users and 30M documents, to migrate which will eventually all end up in Datomic. The Postgres database size looks a bit high, so infra team is complaining. Any advice?
ghadi 2026-02-09T16:51:16.898549Z
are you running garbage collection?
āļø 1
Ben Kamphaus 2026-02-09T17:02:26.556839Z
Iām not sure what other bells & whistles the datomic support team has in place, now, but if you can tolerate a bit of downtime at some point, backup/restore to a new e.g. table, storage instance/system (w/latest transactor) can get you through all the layers of intermittent failed indexing garbage, datomic gc-storage and gc-deleted-dbs vs. storage level vacuum, etc.
š 1
ghadi 2026-02-09T17:06:15.684229Z
We did recent fix a bug that caused some unreachable garbage. https://docs.datomic.com/changes/pro.html#1.0.7469
š 1
ghadi 2026-02-09T17:07:11.078809Z
unfortunately the garbage is unreachable, so the only workaround if you care about that storage space is to backup/restore to an empty place, as Ben mentions
2026-02-10T08:15:34.600789Z
I'll have a chat with the infra team who's managing the whole infra, thank you very much