Fork me on GitHub
#clojure-europe
<
2020-11-11
>
dharrigan06:11:14

Good Morning!

plexus06:11:43

@mpenet also consider #asami! It performs really well and has a query planner.

val_waeselynck15:11:54

@plexus any resources on how well it performs?

plexus16:11:08

Some discussion here https://clojurians-log.clojureverse.org/datalog/2020-08-03 . Usual microbenchmark caveats apply. Please feel free to try for yourself and challenge my findings.

mpenet16:11:07

asami seems to do a lot of fancy things to optimize queries (caching execution plans & co), not sure datascript does any of that. I wonder about db init/"loading" times

val_waeselynck16:11:10

@plexus thanks. Indeed, for DataScript and Datomic, my empirical measurements are that the Datalog engine makes basic queries about 100X slower than code manually-optimized using index lookups.

val_waeselynck16:11:10

Hence my interest in writing a Datalog compiler

val_waeselynck16:11:44

AFAIK, Datomic also caches query plans; the cost I mentioned above remains in spite of that. I don't know about DataScript.

val_waeselynck16:11:34

In Datomic, an index lookup takes about 1µs; a Datalog query will take at least 100µs no matter how little it does.

plexus06:11:51

Good morning!

borkdude08:11:49

@plexus Asami seems exciting to me. I remember the talk from ClojureD. I wonder if it works with GraalVM as well

simongray09:11:02

@mpenet I’ve been researching this topic a bit since I need to find a new home for an RDF dataset (the Danish WordNet) and I didn’t think SQL was a very good fit for it. This may also be interesting to you: https://github.com/simongray/clj-graph-resources

simongray09:11:33

also, good morning

ordnungswidrig15:11:13

What’s the current state-of-the-art-data-analysis-one-shot-tool for clojure? Incanter seems a little rusty nowadays. (I want to take the raw data powering https://pavelmayer.de/covid/risks/, which is a huuuuge csv, and do some (basic) analysis to it: sum/power/timeseries and have some (nice) charts.)

ordnungswidrig15:11:42

that looks fine

otfrom17:11:31

lots of good integration with other data science tools and jvm based things in SMILE

ordnungswidrig14:11:04

Thanks to @otfrom I was able to create my own very non-scientifiy graphs on our counties covid-19 cases 7 daysrolloing average development. This “just a bunch” of statements put together in a repl.

otfrom14:11:59

I'd really be into seeing how you did that if you can share the repo

ordnungswidrig15:11:38

let me collect this into a gist

ordnungswidrig15:11:36

it might run out of the box

otfrom18:11:57

I'm sure it is as bug free as all code is

borkdude15:11:36

I'm sure @otfrom has useful info on this

borkdude15:11:09

and of course there's clojure.data.csv to parse csv's

mpenet15:11:48

@plexus I have my eyes on Asami as well 🙂

mpenet15:11:17

@borkdude https://github.com/exoscale/telex (here be dragons, it's alpha, a real alpha)