Fork me on GitHub

If I ::xt/put equivalent documents (same :xt/id and everything else) 99,000 times with distinct effective dates, does xtdb store 99,000 copies or does it economize by recording numerous references to the same thing?


If I am not mistaken, the temporal indices will grow accordingly but the others don't. So you store 99.000 timestamp + some hash. The other índices remain the same after the first put.

🙏 1

^ that's correct, yep. The docs in the document store are deduplicated, and the indexes are deduplicated. The only things using up space (in the long term) are the tx-log and the 2x temporal indexes, which both store hashes and timestamps


Perfect for storing my recurring thoughts. I’ll pick up a 2K thumb drive.

🙂 1
😆 1