alternatively, if i only have a single Onyx node would it be storing any data (PII specifically) in ZK?

if it's just checkpoint/state data then no ssl might be ok.

@devth we don’t currently expose a way to do this, but nippy does support encryption, so we would need to expose it somehow https://github.com/onyx-platform/onyx/blob/d1d0db97332b52659947bf88499f7228b9f5d2f0/src/onyx/compression/nippy.clj#L19

Even with a single Onyx node, you will still need to place the job data in ZK

but that’s purely the job definition that you submit, not the data that is pushed through Onyx

right, so I might be ok

i'm streaming Datomic -> ElasticSearch

that means basis-t would be in ZK right? but never entities/attributes/values

still interested in encryption but this might allow me to backlog it

That’s right.

also: any plans to make the coordination pluggable?

e.g. consul, etcd, ...

No plans currently. I’d accept a PR, but it’s too much work for not enough gain for us, especially considering that I’d want to jepsen test it

ok. ZK is great from my experience but lack of SSL and the weirdness around 3.5.x release makes me a little nervous :thinking_face:

I haven’t used it, but I had thought ZooKeeper does support SSL https://cwiki.apache.org/confluence/display/ZOOKEEPER/ZooKeeper+SSL+User+Guide

not in any released version. just 3.5.x (alpha, beta)

which means there's no docker image. (i had to create my own)

Ah wow. That’s been in the works for a while.

also that's only client-to-zk ssl. not server-to-server ssl

yep. years 😴

@lucasbradstreet what check pointing storage systems are supported/planned for 0.10 . I know s3

Think I used the right terms there, lol

Only s3 currently. HDFS and google's S3 equivalent would be the nice to have, but would need to be supplied via PR or as contracted work.

Gotcha

if you need an S3-compatible service but aren't using AWS you can run a Minio (we do in GCP) https://github.com/minio/minio

Cool, yeah our plan is in aws on mesos/dcos. I have seen minio

Just curious because we have an odd ball use case for an on prem solution

is there an endpoint i can monitor or a proc i can run to ensure my onyx infra is healthy?

@devth http://www.onyxplatform.org/docs/user-guide/latest/#_health_checks

onyx-peer-http-query is a must.

@michaeldrogalis thanks. not sure why google didn't find that :thinking_face:

@devth No worries

trying to figure out why after adding [org.onyxplatform/onyx-peer-http-query "0.9.15.1"] to my dependencies, lein test now errors with:

java.lang.ClassNotFoundException: io.aeron.CommonContext

clojure.lang.ExceptionInfo: No http query server implementation found. Did you include org.onyxplatform/onyx-node-query in your dependencies and require onyx.http-query in your peer bootup namespace?

what version of onyx are you using? 0.9.15?

yeah

weird. Looks like a problem with it not bringing in the right aeron dependency

ah core was on 0.9.10. all the other plugins were on 0.9.15

yep that caused it

Great

thx. guess i need to make sure those are all kept in sync

Yes please