Fork me on GitHub
#onyx
<
2019-01-09
>
kwladyka09:01:24

What are downsides of onyx? Do you recommend to use it? I am thinking about it in the context of generating dynamic PDF (labels). But response needs to be ASAP. Not sure if processing in onyx add too long delay? How long? Do you recommend onyx for such case?

chrisblom09:01:59

Operations are tricky, but in my experience it was plenty fast

chrisblom09:01:25

Are you sure you need all the functionality that onyx provide? Using onyx can be worth it for complex stream processing , but for simple use cases it is overkill IMO

kwladyka09:01:10

So what is the delay using onyx vs do operations immediately on API request?

kwladyka09:01:27

I am not sure 🙂

kwladyka09:01:35

That is why I am here.

kwladyka09:01:31

I am thinking about onyx not as solution for complex processing, but as solution to scale number of workers to convert data to PDF.

kwladyka09:01:15

But maybe better idea is to run more instances of service in kubernetes.

kwladyka09:01:32

I don’t feel confidence about scaling up

kwladyka10:01:48

steps for precessing are probably simple: 1) fetch data every X minutes / manually by UI / by API request 2) use this data with template to generate PDF 3) return / send / save PDF

chrisblom10:01:54

I don't thinks onyx suits your use case

chrisblom10:01:50

How are you running this? on AWS/GCP/Azure?

kwladyka10:01:58

I will use Google Cloud (at least this is a plan)

chrisblom10:01:04

I'd either put the fetched data on a queue (RabbitMQ, or something similar) and create workers that read from this queue, generate the pdf and save / send it

chrisblom10:01:04

this way you can add more worker nodes if you need more capacity

kwladyka10:01:43

Could be why queue system, but not onyx?

chrisblom10:01:27

It's easier to setup and operate

chrisblom10:01:14

With onyx you will need to run a zookeeper cluster, a likely some queue as well to get your data into onyx

kwladyka10:01:09

Oh I though onyx is more independent solution

kwladyka10:01:04

Why there is no work about that in readme?

kwladyka10:01:28

so it looks like onyx environment is maybe unnecessary complex for me

kwladyka10:01:41

thanks for that info

kwladyka09:01:56

I see in repository there are plugins like onyx-seq which don’t exist. Is onyx still well supported ?

👍 5
kwladyka09:01:52

I see there is not a lot of commits, but 76 issues not resolved