Clojurians Log v2
Clojure programming
Channels
Apps
datahike
alekcz 2024-11-11T23:21:46.862539Z
When importing my db the raise macro is an issue. It throws the transaction that caused it. Which in this case is 600M datoms. So my terminal/repl crashes.
https://github.com/replikativ/datahike/blob/12c68ee3c7796c90fddcae5117b7d9efe78b1481/src/datahike/tools.cljc#L71
alekcz 2024-11-11T23:22:10.206819Z
Would it be possible to limit how much data is thrown?
whilo 2024-11-11T23:38:46.347379Z
Yes, that would make sense.
whilo 2024-11-11T23:38:53.652609Z
Ideally it should not throw at all.
whilo 2024-11-11T23:39:13.443199Z
I think the migrate namespace assumes that you can load everything into memory at once https://github.com/replikativ/datahike/blob/12c68ee3c7796c90fddcae5117b7d9efe78b1481/src/datahike/migrate.clj#L30
alekcz 2024-11-11T23:22:23.079639Z
My repl is running with 6GB