onyx

Drew Verlee 2024-05-02T17:08:15.528549Z

Has anyone used a streaming system like onyx, that made it easy to run the same jobs in memory in the same way as they might be run across multiple machines?

Travis 2024-05-02T17:09:36.437819Z

Guess it depends on what your looking for but I use kafka streams pretty heavily

Drew Verlee 2024-05-02T17:15:34.582319Z

Thanks Travis, i'm looking for the dataflow abstraction (windows, triggers, etc...) but in a single threaded process.

Drew Verlee 2024-05-02T17:16:22.753529Z

that can also be deployed in a distributed system

Drew Verlee 2024-05-02T17:17:21.079629Z

about 7 years ago when i looked into this, only Onyx seemed like they were trying to do this. Everything else seemed like they wanted to claim they could, but when you actually got into the docs, i felt what you learned is that serious modifications (not just additions) had to be made to transition.

Travis 2024-05-02T17:23:49.351839Z

you can do a lot of windowing in kafka streams

Travis 2024-05-02T17:24:24.322319Z

they support most of the same ones onyx did

Travis 2024-05-02T17:25:09.049659Z

It also easy to run locally in a test with out infrastructure and to scale