Fork me on GitHub
#announcements
<
2022-06-03
>
Clojask04:06:53

Hello! We are very excited to share with you the first release of https://github.com/clojure-finance/clojask. Clojask is a parallel data processing framework that is designed for large datasets, inspired by Dask, Spark and NoSQL databases. Features: • Optimized for larger-than-memory datasets • Various Operations, including https://clojure-finance.github.io/clojask-website/posts-output/API/#group-by, https://clojure-finance.github.io/clojask-website/posts-output/API/#aggregate, https://clojure-finance.github.io/clojask-website/posts-output/API/#inner-join--left-join--right-join, even for larger-than-memory datasets! • Faster than Dask on most of our https://clojure-finance.github.io/clojask-website/pages-output/about/#benchmarks • All native data types • From file to file • Parallel computation • Lazy operations #clojask

🎉 22
clojure 9
👍 6
🚀 5
punit-naik14:07:02

@U03JDCVV1MX I see that clojask will be run using Onyx. But active development on onyx has been stopped since 31 August, 2019. Will this be a problem? Just wondering.

Clojask14:07:26

Yes, it has been a problem for us mostly with the Java supported version. Clojask supports Java 8-11 only because Onyx only supports these.

👍 2
Clojask12:07:27

If necessary we would be willing to make some fixes in the future to Onyx to use a different version of Java. So far in the past, however, we have focused on getting Clojask up and running.

👍 2
punit-naik12:07:57

Got it!

👍 1
Matthew Davidson (kingmob)07:06:32

Gloss 0.3.0 is now out for all your on-the-wire byte parsing needs! https://clojars.org/org.clj-commons/gloss Major changes: • Fix JDK11+ reflection bug • Support Graal • Add int24 and uint24 support Many thanks to the contributors: Zach Tellman, Alexander Kahl, Mihir Rege, Erik Assum, Matthew Davidson, skynet, and Ning Sun

🎉 12
0️⃣ 4
1️⃣ 4