This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2017-04-09
Channels
- # beginners (41)
- # boot (4)
- # cider (36)
- # cljsrn (9)
- # clojure (365)
- # clojure-dev (1)
- # clojure-dusseldorf (1)
- # clojure-nl (1)
- # clojure-russia (3)
- # clojure-spain (1)
- # clojure-spec (19)
- # clojure-uk (1)
- # clojurescript (159)
- # code-reviews (7)
- # core-async (51)
- # cursive (2)
- # datascript (1)
- # datomic (1)
- # emacs (5)
- # figwheel (3)
- # hoplon (18)
- # incanter (1)
- # lein-figwheel (1)
- # leiningen (3)
- # lumo (145)
- # off-topic (26)
- # onyx (21)
- # re-frame (2)
- # reagent (45)
- # rum (4)
- # uncomplicate (10)
- # untangled (23)
- # yada (6)
A general distributed systems question: do you think things like Docker Swarm and Kubernetes could benefit from the log-based implementation Onyx has?
@yonatanel what exactly do you mean ?
having said that, i do believe that it is an appropriate abstraction for many types of distributed systems
if i recall correctly, zookeeper’s consensus algorithm is some kind of variant of Paxos (or at least, it was a while back)
where Onyx claims to be masterless, it’s actually Zookeeper’s protocol that does the leader election
Not so sure about Paxos but both docker swarm and Kubernetes run Raft for consensus which uses a distributed log state machine at its core.
in the end, it’s very difficult to implement a truly decentralised log without some form of leader-based consensus algorithm - bitcoin comes to mind
so you usually have to build a log on top of a stateful consensus algorithm — not sure what the added value of that would be for Kubernetes or Swarm
@lmergen it's true ZK is needed for leader election when exactly-once processing is desired, since a peer needs to be elected to coordinate barrier injection.
zookeeper is pretty much an accepted “evil” in the world of jvm-based distributed systems nowadays
@lmergen Chose the term “masterless” instead of “peer-to-peer” since ZooKeeper is still doing it’s own leader election, despite Onyx itself having no leader. I try to make that distinction where I can - there wasn’t a good word for it. 🙂
yeah i wasnt really complaining - in fact, it's a good thing, by saying Onyx is masterless and uses Zookeeper you provide a lot of context/information about its architecture and the tradeoffs it has made.
No prob, I get asked that a lot. Definitely not trying to be unclear about how it works, anyway.