This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2020-03-22
Channels
- # announcements (2)
- # babashka (18)
- # beginners (87)
- # calva (22)
- # chlorine-clover (5)
- # cider (11)
- # clj-kondo (10)
- # clojure (71)
- # clojure-austin (1)
- # clojure-norway (6)
- # clojure-uk (13)
- # clojurescript (3)
- # core-async (10)
- # data-science (17)
- # datascript (1)
- # datomic (22)
- # emacs (10)
- # fulcro (32)
- # hoplon (8)
- # jobs-discuss (2)
- # malli (5)
- # meander (5)
- # nrepl (35)
- # off-topic (8)
- # pathom (38)
- # planck (21)
- # re-frame (10)
- # reagent (17)
- # reitit (7)
- # shadow-cljs (26)
- # tools-deps (3)
- # xtdb (7)
Q: I have a stock prod topology and I have started load testing readonly loads. when I max it out, the cpu tops out at approx 50%. Am I right in understanding this is because only one of the two server nodes is handling queries?
@U05120CBV could you comment on this?
I have a cljs lambda which calls two Ion fns. Both are read only. I use Gatling to create increasing levels of load. It reaches an asymtote pretty quickly and the CPU chart in the dashboard never goes above 50% when it hits the asymtote
so I guess it is a single source but I’m not sure how lambdas scale out. are you suggesting that, if > 1 lambda is making the call, it will distribute across both nodes?
I suspect it has to do with traffic routing on a per database basis for the primary compute group, but i dont know for a fact. I would suggest trying it against a query group
But also, the thing that matters is your read throughput, not the distribution of cpu usage
digging in. my cljs lambda invokes the Ion lambda via the npm aws client. not sure if that is relevant
also my Ions work with N datomic databases, not just a single one. I’ve segregated database based on usage requirements
in my startup status (i.e. low budget) I’m trying to minimise costs. adding a query group implies extra cost right?
I dont know of the top of my head how the dashboard reports cpu usage. You can always look at individual ec2 instance cpu metrics if you want to examine things further
here’s a thought. would the routing system be different if I started using http-direct for this Ion invocation? It’s something I’ve been meaning to do anyway
@U05120CBV ok. I have since verified that under load, only one of the two nodes are being used for reads. with the OOTB topology, should the load be spread across both? if so, what’s the next step to diagnosing this? Is it possible that my cljs/aws api Ion invocation is somehow affecting the load balancer?
(interestingly the architecture diagrams don’t show an NLB behind the lambdas or direct. I trust your statement despite that 🙂
Can we translate number of datomic system with the number of transactors?