Fork me on GitHub
#onyx
<
2016-05-26
>
michaeldrogalis01:05:08

Would anyone running Onyx in-house be interested in a twice-monthly knowledge sharing session/show-and-tell-thing? It'd be interesting to see how companies are managing their Onyx deployments in the wild. We can answer questions during that time, too. Anyone else is welcome to lurk as well.

nha08:05:02

I would gladly lurk 😉

acron10:05:49

@michaeldrogalis: definitely would attend, as would a couple of my peers (aha!)

manderson12:05:57

@michaeldrogalis: I'd be interested in lurking and perhaps presenting down the road. I got pulled into another project for the last few months, but should be back working with Onyx soon as the other project is wrapping up.

jeroenvandijk13:05:46

@michaeldrogalis: I think we would be interested at some point (too early now I suppose)

michaeldrogalis14:05:10

@nha @acron @manderson @jeroenvandijk @greywolve Cool, we could do the first one and talk about the new application template that's coming out for 25-30 minutes or something. @gardnervickers has lots to show.

michaeldrogalis14:05:04

... Timezones are going to be hard. Just from you all above, that stretches from the Pacific coast to eastern Europe at least.

v.solovyov14:05:53

I would like to tune in and listen as well

michaeldrogalis14:05:45

I'll send out a poll thingy later today or tomorrow so that we can pick an optimal time, then. Having some mind-share between the community will take us all a long way. 🙂

tcoupland14:05:38

sounds great! very interested

lucasbradstreet14:05:06

@michaeldrogalis: lets send poll out to the newsletter list too. I’d like to hear about what people want to hear from that too

michaeldrogalis14:05:45

Excellent. @tcoupland @v.solovyov @manderson @acron @nha: If ya'll are signed up for the news letter, can you PM me your emails so I can send directly? I'd look you up here later, but Slack deletes messages 10,000 back 😞

lucasbradstreet14:05:02

Anyone else who isn’t signed up for the newsletter, here is the link: http://eepurl.com/beFW_P

zmaril15:05:14

Is there anything yet that allows for repeating tasks like cron?

lucasbradstreet15:05:16

Unfortunately not. You could use a task with a timer trigger to inject “task” segments, but this is non-ideal because they wouldn’t be outputting to the same job

lucasbradstreet15:05:26

This will get better in a future release

michaeldrogalis15:05:49

We're unlikely to ever add a cron-scheduler to Onyx. It's out of scope for the project. You'd be much better served by a project that specifically does scheduling.

michaeldrogalis15:05:31

Individual tasks that perform some action on a timer, as @lucasbradstreet said, are one thing. But for job and task repetition, you should look elsewhere for a supporting tool.

zmaril15:05:41

I see, thanks.

zmaril15:05:17

Sketching out a scraper architecture in my head and trying to fit all the pieces together

lucasbradstreet15:05:26

something like mesos chronos or whatever kubernetes is doing is probably the right place to manage those sorts of jobs

lucasbradstreet15:05:56

alternatively have a process that just writes a segment to a kafka/whatever topic every now and again and make sure you monitor it

zmaril15:05:57

Yeah the main concern is having an easy ui rather than distributed systems guarantees. Thanks though!

fhanreich17:05:12

@michaeldrogalis: (on Onyx in-house) we are not using Onyx yet, but hopefully in the near future. I’d love to lurk as well!

gardnervickers17:05:37

This is going to be fun