Fork me on GitHub
#clojure-europe
<
2020-11-18
>
dharrigan06:11:01

Good Morning!

javahippie07:11:29

Guten Morgen!

ordnungswidrig08:11:42

’good ’morning

slipset09:11:07

good morning!

otfrom21:11:16

so, transit-clj seems to be fast and compact (when using :msgpack and GzipOutputStream) for my needs. i'm pretty happy with it

otfrom21:11:08

I'm using the reducibles library. I just need to figure out how to deal with a seq of reducibles and/or eductions. I'm not quite sure where to draw the line for using things like (take 2) and only getting part of the first file

otfrom21:11:18

It is pretty easy for ingesting everything

otfrom21:11:54

yeah, just checked on all the data and it takes bout 20% of the time that nippy does

dominicm21:11:30

I had some issues with transit doing too many tiny chunks completely defeating gzip

otfrom23:11:28

For my data structure it seems to be working atm

otfrom23:11:00

I'm writing 50 largish vectors to a file getting gzipped

otfrom23:11:21

Each file ends up around 7MB