Fork me on GitHub
#onyx
<
2017-07-21
>
lxsameer15:07:39

guys, can I have two set of workers separated data center ? I want to run specific kinds of jobs an one them

gardnervickers15:07:14

@lxsameer It’s not recommended to run a single onyx cluster over multiple data centers. Latency will be hard to adjust around, and will create problems. A better approach would be to run one Onyx cluster in each data center.

lxsameer15:07:56

@gardnervickers latency wouldn't be problem for my use case, I have several long running jobs which I want to setup some else and store the output in a data store

gardnervickers15:07:46

I’m talking more about latency between Zookeeper and Onyx, not so much latency within your job.

lxsameer15:07:29

Aha that make sense then

gardnervickers15:07:41

It’ll require tweaking various timeouts quite a bit. Is there any reason why multiple Onyx clusters won’t work for you use case?

lxsameer15:07:42

no specific reason

michaeldrogalis15:07:17

It could work, but I’d recommend solving whatever problem you’re up against with a different approach rather than doing cross datacenter Onyx.

lxsameer15:07:17

cool, thanks guys