Fork me on GitHub
#onyx
<
2016-02-23
>
michaeldrogalis03:02:45

@robert-stuttaford: @lsnape Aaand we're live with some replica query support, both in Clojure and over HTTP: https://github.com/onyx-platform/lib-onyx#api-docs

michaeldrogalis03:02:47

@lsnape: This should make the front end a lot faster to build. @robert-stuttaford this should be an adequate stop gap for your deployment scenario.

robert-stuttaford06:02:37

looks like it needs to be provided but set to nil

robert-stuttaford06:02:26

ok. looks like the http://checkip.amazonaws.com thing is no longer true. schema rejects anything but a string

lucasbradstreet06:02:17

Isn't that a string when you slurp it?

robert-stuttaford06:02:16

so i can just put the address in there?

lucasbradstreet06:02:20

Anyway if I remember correctly that's not the url we use

robert-stuttaford06:02:51

ok. currently scripting the injection of the instance public ip into that space prior to start

lucasbradstreet06:02:56

@robert-stuttaford: this is what I do on AWS `(merge {:onyx.messaging/bind-addr (slurp "http://169.254.169.254/latest/meta-data/local-ipv4")} peer-cfg)`

lucasbradstreet06:02:09

I’ll fix that doc thanks

lsnape08:02:14

@michaeldrogalis: Sweet. I’ll check it out. Today’s gonna be chock-a-block for me (my partner thinks that DIY takes priority over open source?!) though might be around a couple of hours this evening (UTC)

greywolve08:02:11

our cluster is up and working 😄

lucasbradstreet12:02:52

New Amazon SQS plugin donated by http://www.lockedon.com as part of our consulting work! https://github.com/onyx-platform/onyx-amazon-sqs

lucasbradstreet12:02:33

Note that it's not up on clojars yet.

lucasbradstreet12:02:11

SQS is actually a pretty good fit for Onyx if you want to get up and running quickly with something hosted

robert-stuttaford13:02:42

we could use that to push work into our system too, if we needed to

robert-stuttaford13:02:47

rather than the core.async thing

lucasbradstreet13:02:40

I was just thinking that you might want to use it for a side channel rather than another Datomic DB. It's really easy to use

lucasbradstreet13:02:57

Another thing it might be useful for is failing flow conditions can output to a queue for processing later

robert-stuttaford14:02:58

a longer term scaling question, @lucasbradstreet - i know we’d move ZK to its own instances. would we do the same for aeron?

lucasbradstreet14:02:54

You'd keep the Aeron media driver. It's kind of like a userland TCP stack

robert-stuttaford14:02:33

so we’d always have Onyx + Aeron contending for resources on an instance

robert-stuttaford14:02:16

i wonder how we’d know it’s time to move ZK off to its own instances

robert-stuttaford14:02:33

the recommended setup is 3x ZK and 3x Onyx, for a total of 6 instances, right

lucasbradstreet14:02:45

It's hard to know when that might happen. Probably when you start seeing the ZK leader change often

lucasbradstreet14:02:08

3xZK and 3xOnyx is the recommended setup. The ZK boxes probably wouldn't need to be very big

lucasbradstreet14:02:30

I think you can get away with running them on the same box for quite a while as long as your config is right

lucasbradstreet14:02:37

It's mostly an isolation thing, as you say

robert-stuttaford14:02:56

signing off for now. catch you, Lucas!

michaeldrogalis15:02:40

@lsnape: Cool, have a good one simple_smile

lucasbradstreet15:02:22

@gardnervickers: did we decide to add add-task to onyx core? I can’t remember how that ended up 😕

lucasbradstreet15:02:50

I added it to my task ns for now, because I needed it for the tests, like you did

michaeldrogalis15:02:19

You can add it to core.

lucasbradstreet15:02:48

Cool, I think it’s time

lucasbradstreet15:02:09

onyx.job? Probably better than onyx.job.utils

gardnervickers15:02:56

@lucasbradstreet: I had it in onyx.api for the build I was using when adding bundles to the plugins but onyx.job makes more sense

michaeldrogalis15:02:14

That's fine to me.

lucasbradstreet15:02:24

I think we’ll end up building some more functions for job manipulation which is why I prefer onyx.job

gardnervickers15:02:40

will you add it to stateful-reducers branch?

gardnervickers15:02:54

it’ll be nice not having to maintain a different build

lucasbradstreet15:02:41

stateful-reducers was merged into develop

lucasbradstreet15:02:46

So I’ll put it in develop

gardnervickers15:02:24

even better thanks