Fork me on GitHub
#onyx
<
2015-11-12
>
michaeldrogalis04:11:33

I believe @lucasbradstreet discovered this, bug fix is pending in https://github.com/onyx-platform/onyx/issues/344. It's tough to reproduce since its non-deterministic when it happens, I think the fix isn't too bad though

bsima14:11:24

Would you guys say that onyx is a solution to the problem of managing dependencies among asynchronous operations?

lucasbradstreet15:11:34

Yes, I'd say it's an excellent solution for that, especially if you want to ever want to connect up channels between networked nodes (which is something that onyx essentially gives you for free)

lucasbradstreet15:11:18

We've had users do benchmarks on local nodes and we're within 10% of pure core.async when running locally

bsima15:11:06

cool thanks, I'll make a note of it on SO. I wasn't sure if I needed everything that Onyx brings in (cluster management and all) but after thinking about it some more, starting with Onyx now just gives me more ability to scale up in the future if need be

lucasbradstreet15:11:27

Yep, that's something we've focussed on a lot. Making it easy to get up and running with one node but able to scale later

lucasbradstreet15:11:02

Working on pure channels does give you some features like working directly with transducers, so it's not an exact mapping

michaeldrogalis15:11:46

Onyx 0.8.0 is officially out! Thanks to everyone who helped us get it ready! https://twitter.com/OnyxPlatform/status/664826349987627008

kazuwal15:11:55

Any plans for a book / videos tutorials guys?

michaeldrogalis15:11:53

@adebesin: Video series already in the works. simple_smile

kazuwal15:11:28

awesome 👍

lucasbradstreet15:11:46

learn-onyx is a good way to go through learning the bits and pieces

kazuwal16:11:58

@lucasbradstreet: Thanks! I have just started playing around with Onyx but still havent figured out what its strengths are. At work we are currently using Spark after moving away from Hadoop and Hive. How does Onyx differ from Spark in the context of functionality ?

lucasbradstreet16:11:20

Spark is good - I’d say that our main strength against Spark is that we’re more stream orientated, which results in lower latency processing than Spark’s micro batching can

michaeldrogalis16:11:03

I hate to be cliche, but Onyx's API is markedly more decomplected. There, I used the D word.

lucasbradstreet16:11:19

And yes, there’s also the usability aspect

yusup16:11:10

great job! 👍

michaeldrogalis20:11:52

@spangler: How often are you hitting that exception? I think it's exacerbated by that fact that your messages are large and take a while to ack.

spangler21:11:34

@michaeldrogalis About 1 out of 20 jobs... each each job runs hundreds of tasks

kazuwal21:11:51

Spark as a concept is obviously great but Scala is such a dreadful language far to complex to be any where near productive. I think the Clojure community needs Onyx and we should all get behind promoting its potential. I'm glad you guys took on the challenge.. great work 👍

michaeldrogalis21:11:47

@spangler: Okay. Sorry, you've admittedly been hitting a lot more bugs than other people because you're using features that have gotten less mileage. This one is particularly annoying because its non-deterministic. I have an idea for a temporary fix to get you going if I cant get a proper fix soon.

michaeldrogalis21:11:56

@adebesin: Thanks! We really appreciate that! simple_smile

spangler21:11:11

@adebesin It does have great potential

michaeldrogalis21:11:28

Might just implement that method its complaining about missing on the Function record and no-op it

michaeldrogalis21:11:06

Build is running, I added this patch: https://github.com/onyx-platform/onyx/commit/60e4d0169939260245ae588a85c2cfb7b052ebd0 Should pass the tests, hopefully it's enough to keep moving.

michaeldrogalis22:11:11

@spangler: It passed the tests. Give the latest SNAPSHOT a try. Hope it does the trick for now.