Fork me on GitHub
#xtdb
<
2022-11-25
>
phill00:11:34

If I ::xt/put equivalent documents (same :xt/id and everything else) 99,000 times with distinct effective dates, does xtdb store 99,000 copies or does it economize by recording numerous references to the same thing?

FiVo08:11:21

If I am not mistaken, the temporal indices will grow accordingly but the others don't. So you store 99.000 timestamp + some hash. The other índices remain the same after the first put.

🙏 1
refset12:11:53

^ that's correct, yep. The docs in the document store are deduplicated, and the indexes are deduplicated. The only things using up space (in the long term) are the tx-log and the 2x temporal indexes, which both store hashes and timestamps

macrobartfast05:11:46

Perfect for storing my recurring thoughts. I’ll pick up a 2K thumb drive.

🙂 1
😆 1