Fork me on GitHub
#datahike
<
2022-07-14
>
timo13:07:12

Today we will not meet

awb9919:07:41

Is there a migration tool for the datahike db dumps? I have a dump from 0.4 and this cannot be read from 0.5. Alternatively, is it safe to read db created with 0.4 with 0.5 ? This way I could use a datahike file store db to import the old dump with 0.4 version and then export a new dump with 0.5 version.

timo07:07:52

I think the import from 0.4 to 0.5 is not working currently. Maybe @UB95JRKM3 can help?!

awb9900:07:52

thanks! good to know. what do I do now to migrate from 0.4 to 0.5 ? 😥

kkuehne13:07:45

Hi @UCSJVFV35, how did you create the dump? Currently 0.5 is not able to read the old version since with the konserve change with 0.5 the storage layout has changed in order to use GC on the index fragments. I'm currently writing a commandline script to export any version to a temporary nippy format and import it with the latest version. Would that be something that would help you?

awb9921:07:09

Hi @UB95JRKM3 yes this would help a lot!

awb9921:07:19

I have a lot of issues with dump and restore: https://github.com/replikativ/datahike/issues/531

awb9921:07:51

I made a little production app with datahike. And I use the dump feature to make a backup of the database once a week.

awb9921:07:06

I have had problems with restoring dumps for 6 months now.

awb9921:07:30

Typically I have to edit the dump, remove the transactions which cause the import to stop, store

awb9921:07:42

them in a separate file, and then add them manually as transactions again.

awb9921:07:01

I think it must be a very simple issue that the dump is suffering from.

awb9921:07:26

It might be related to the fact, that I have redefined (expanded, not changed) the schema a couple of times, as I was developing the app.

awb9921:07:59

With 0.4.1480 it got better, now it takes me 4 hours to process the dump,

awb9921:07:03

before it was 2 days.

awb9921:07:23

I think currently only the last fields that I have added to the schema are making problems.

awb9904:07:39

Hi @UB95JRKM3 Any luck with your script?