Fork me on GitHub

Hello! We are very excited to share with you the first release of Clojask is a parallel data processing framework that is designed for large datasets, inspired by Dask, Spark and NoSQL databases. Features: • Optimized for larger-than-memory datasets • Various Operations, including,,, even for larger-than-memory datasets! • Faster than Dask on most of our • All native data types • From file to file • Parallel computation • Lazy operations #clojask

🎉 22
clojure 9
👍 6
🚀 5

@U03JDCVV1MX I see that clojask will be run using Onyx. But active development on onyx has been stopped since 31 August, 2019. Will this be a problem? Just wondering.


Yes, it has been a problem for us mostly with the Java supported version. Clojask supports Java 8-11 only because Onyx only supports these.

👍 2

If necessary we would be willing to make some fixes in the future to Onyx to use a different version of Java. So far in the past, however, we have focused on getting Clojask up and running.

👍 2

Got it!

👍 1
Matthew Davidson (kingmob)07:06:32

Gloss 0.3.0 is now out for all your on-the-wire byte parsing needs! Major changes: • Fix JDK11+ reflection bug • Support Graal • Add int24 and uint24 support Many thanks to the contributors: Zach Tellman, Alexander Kahl, Mihir Rege, Erik Assum, Matthew Davidson, skynet, and Ning Sun

🎉 12
0️⃣ 4
1️⃣ 4