:error {:task-map {(not (= (name (:onyx or :kafka)) (namespace a-clojure.lang.Keyword))) invalid-key}}}

Tried posting more but Slack says no storage left

@emergence It’s complaining about the namespace of a key in your catalog.

Are you using an undefined :onyx/* or :kafka/* keyword?

We restrict those keys to detect typos.

Schema’s output is pretty trash 😕

I was working with an example using an older version of onyx-kafka so it's possible -- this is my config.edn

{:env-config
 {:onyx/tenancy-id #profile {:default "1"
                             :docker #env ONYX_ID}
  :zookeeper/address #profile {:default "127.0.0.1:2181"
                               :docker "zookeeper:2181"}
  :onyx.log/config #profile {:default nil
                             :docker {:level :info}}}
 :peer-config
 {:onyx/tenancy-id #profile {:default "1"
                             :docker #env ONYX_ID}
  :zookeeper/address #profile {:default "127.0.0.1:2181"
                               :docker "zookeeper:2181"}
  :onyx.peer/job-scheduler :onyx.job-scheduler/balanced
  :onyx.messaging/allow-short-circuit? #profile {:default false
                                                 :docker true}
  :onyx.messaging/impl :aeron
  :onyx.messaging/bind-addr #or [#env BIND_ADDR "localhost"]
  :onyx.messaging/peer-port 40200
  :onyx.messaging.aeron/embedded-driver? #profile {:default true
                                                   :docker false}
  :onyx.log/config #profile {:default nil
                             :docker {:level :info}}}
 :kafka-config
 {:onyx/name :in
  :onyx/plugin :onyx.plugin.kafka/read-messages
  :onyx/type :input
  :onyx/medium :kafka
  :kafka/topic "answers"
  :kafka/group-id "onyx-consumer"
  :kafka/receive-buffer-bytes 307200
  :kafka/zookeeper "127.0.0.1:2181"
  :kafka/offset-reset :earliest
  :kafka/commit-interval 500
  :kafka/deserializer-fn :streaming-answers.util/deserialize-message-transit
  :kafka/wrap-with-metadata? false
  :onyx/min-peers 1
  :onyx/max-peers 1
  :onyx/batch-size 100
  :onyx/doc "Reads messages from a Kafka topic"}
 :batch-config
 {:onyx/batch-size 1
  :onyx/batch-timeout 1000
  :onyx/min-peers 1
  :onyx/max-peers 1}}

Yes I used to like schema but since spec came along ... 🙂

What versions are you on?

[org.onyxplatform/onyx "0.10.0"]
                 [org.onyxplatform/onyx-kafka "0.10.0.0"]
                 [org.onyxplatform/lib-onyx "0.10.0.0"]

I bet it’s commit-interval

We might have forgotten to remove that from the examples

I hava Kafka, zookeeper and dash running ... can also start peer though I get this error re: logging

Incompatible versions of the Onyx cluster coordination log.
                     A new, distinct, :onyx/tenancy-id should be supplied when upgrading or downgrading Onyx. {:cluster-version "0.9.16-SNAPSHOT", :peer-version "0.10.0"}

going to try to remove that key and see what happens (commit-interval)

Yeah you’re going to need to wipe ZK or use a new tenancy ID. 0.9 and 0.10 are incompatible

ok will tweak that too

Thanks for your help on this btw 🙂

@michaeldrogalis bumping tenancy-id cleared the incompatibility error and pulling that key allowed me to submit my job -- thanks!

@emergence No problem