Fork me on GitHub
#onyx
<
2018-04-18
>
wildermuthn15:04:55

Hey Onyx team. I haven’t used Clojure or Onyx in about 6 months, but it’s exciting to see all the continued progress. I have a small question, which is that at my new workplace, we’re heavily invested into Kubernetes. It seems to me that K8 would conflict with the way Onyx already manages its own cluster with Zookeeper. But I’m curious if this has been looked at.

Travis15:04:19

Onyx can run just fine on K8

Travis15:04:07

We have run it for a bit on there. We run both Kafka and zk in K8. Onyx is just a set of pods

Travis15:04:12

Essentially

lucasbradstreet15:04:44

Right. We don’t do anything magical with ZooKeeper outside of the testing only server that can be startup in the env, so all you need to do is startup ZooKeeper containers in k8s and point Onyx at them. :)

wildermuthn15:04:17

I figured there would be problems with Zookeeper/Onyx and K8 fighting to manage bringing nodes (pods) up and down. But awesome. I’ll dig in more then.

lmergen16:04:05

no zookeeper + k8s is not a problem. onyx would probably look a bit differently if it was designed from the ground up for k8s, but i’ve been running it without problems for quite some time

lmergen16:04:51

there’s even a ZK chart already

lucasbradstreet16:04:34

Most of the problems we’ve hit with k8s and kafka/zookeeper were due to how well they run as StatefulSets, and were related to DNS resolution issues that are slowly being fixed in upstream ZooKeeper and Kafka.

lmergen16:04:37

i think it’s mostly Kafka being problematic with broker / node discovery, right ?

lmergen16:04:32

ah interesting

lucasbradstreet16:04:36

Kafka was fine in that respect. Actually I think it was mostly related to these issues so we needed to patch in a ZooKeeper client with a fix into Kafka.

lmergen16:04:15

so that would also be related to the Curator discussion we had last week ?

lucasbradstreet16:04:40

That one was more for SSL for us. But yes, I think we need to upgrade it for that reason too.

lmergen16:04:07

ok, good to know