This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2017-04-28
Channels
- # aws-lambda (2)
- # beginners (49)
- # boot (49)
- # cider (7)
- # clara (1)
- # cljsrn (4)
- # clojure (199)
- # clojure-android (49)
- # clojure-dev (1)
- # clojure-greece (4)
- # clojure-italy (3)
- # clojure-nl (4)
- # clojure-norway (5)
- # clojure-russia (78)
- # clojure-spec (22)
- # clojure-uk (18)
- # clojurebridge (2)
- # clojurescript (252)
- # core-typed (2)
- # cursive (11)
- # data-science (1)
- # datascript (2)
- # datomic (38)
- # devcards (1)
- # flambo (3)
- # hoplon (10)
- # immutant (2)
- # jobs (3)
- # luminus (1)
- # lumo (2)
- # off-topic (8)
- # om (3)
- # onyx (29)
- # parinfer (1)
- # pedestal (4)
- # portkey (13)
- # re-frame (13)
- # reagent (6)
- # ring (3)
- # ring-swagger (15)
- # schema (2)
- # spacemacs (4)
- # test-check (4)
- # untangled (46)
- # yada (2)
@jetmind Ahhh, I presumed you were using Onyx 0.10.
Prior to 0.10 we’d skip networking if possible and go directly to another peer. That’s what’s going on.
0.10's networking is fast enough that the extra step to be smarter isn’t worth it.
I guess I’m stuck with manual realization of lazy seqs for now 🙂 Thanks for your time!
@jetmind No problem. What is blocking you from upgrading?
Ahh, gotcha.
Hi all! Any tip on this exception?
io.aeron.exceptions.DriverTimeoutException: Driver is inactive
java.util.concurrent.ExecutionException: io.aeron.exceptions.DriverTimeoutException: Driver is inactive
clojure.lang.ExceptionInfo: Error in component :virtual-peer in system onyx.system.OnyxPeer calling #'com.stuartsierra.component/stop
component: #<Virtual Peer>
function: #'com.stuartsierra.component/stop
reason: :com.stuartsierra.component/component-function-threw-exception
system: #<Onyx Peer>
system-key: :virtual-peer
@lellis This one is fixed in 0.10.
It’s a bug in the networking code not recovering properly from a downed media driver, possibly because it was starved for resources.
That one’s not due to a dependency. If you’re on 0.10, are you sure you started the media driver to begin with?
That seems reminiscent of it not being found active in the first place.
@lellis that can happen when you get huge GC pauses and aeron doesn’t heartbeat enough. In production we have kubernetes health check our pods and reboot them if the container doesn’t report that the media driver is active https://github.com/onyx-platform/onyx-peer-http-query#route-4
@lellis I would try to look at whether you’re ending up with big GC pauses, and figure out whether you are allocating enough memory, and also evaluate using the G1GC collector to keep pauses down.
Yeah, this is my problem. All my cpu at 100% a lot of time when submit my jobs. If i bring down number of peers all goes ok, but dont start one of my jobs, probably because i dont have enough peers. Its a trick threshold in my machine. Ty for help guys.
So after analysis, i need 46 peers to start all my jobs, but my machine only support 23 peers without media become inactive, any tip how can i setup these number os peers in my machine? 46 Its a huge number os peers for a dev machine?
@lellis Can you test one job at a time? If you’re looking to stand the entire stack up at once, it’s probably time to spin up a few machines in Amazon.
Yeah i have tested one at a time, using onyx-rt and its all ok. Im trying make an end-to-end test of all jobs working in a real env. Probably cant do this in my machine. I will try to deploy and test in my amazon dev env. Ty by attention!
Yeah, Onyx definitely isn’t a light system. It’s trying to parallelize as much as possibly by design. There are a few tricks you can do to fuse consecutive tasks together if they’re light enough, but it sounds like you need a lot more hardware runway first.
@lellis it you try beta14 we have reduced the initial CPU burn when all the peers are setting themselves up
if you aren’t pushing around a lot of data it might be ok
G1GC will also help
@lucasbradstreet Im using "0.10.0-beta8". Will try beta14! ty.
you can also increase http://www.onyxplatform.org/docs/cheat-sheet/latest/#peer-config/:onyx.peer/idle-min-sleep-ns and http://www.onyxplatform.org/docs/cheat-sheet/latest/#peer-config/:onyx.peer/idle-max-sleep-ns to reduce CPU burn when your peers are idle