data-science

eraserhd 2025-03-18T17:16:06.182369Z

Is there a way in a Clay notebook to cache or prevent realoding my dataset? I tried using defonce, but it doesn't seem to work.

Daniel Slutsky 2025-03-18T20:36:45.799959Z

Hi @eraserhd! Thanks for looking into it. Could we discuss it at the Clojurians Zulip chat? The relevant people are more available there. I will be available a little later today, and we can explore together if you wish.

Daniel Slutsky 2025-03-18T20:37:23.166899Z

More about our use of the Clojurians Zulip chat: https://scicloj.github.io/docs/community/chat/

eraserhd 2025-03-18T19:47:22.587469Z

Huh, maybe the problem isn't loading the data? I'm doing live-reload, and it takes a few minutes each time. I moved the file loading into another namespace and used delay; however, it still takes several minutes. Puting a (System/currentTimeMillis) around the data loading, it seems to be taking 20ms (unless Clay evaluates in a weird order?). But it still takes a few minutes to reload when I save the file. 😕

eraserhd 2025-03-18T20:39:45.936839Z

I'll be out 'til tomorrow, but I'll join up. I think I understand that this is all processing though.

Daniel Slutsky 2025-03-19T21:45:02.221089Z

Hi @eraserhd. I just wish to encourage you to discuss it further. There are a few directions worth exploring, I think.

Daniel Slutsky 2025-03-18T21:33:39.457279Z

Thanks. It'll be helpful to learn from your experience and discuss alternatives.