This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2021-10-04
Channels
- # babashka (17)
- # beginners (82)
- # calva (42)
- # clj-commons (9)
- # cljdoc (2)
- # cljsrn (3)
- # clojure (142)
- # clojure-europe (12)
- # clojure-nl (1)
- # clojure-sg (1)
- # clojure-uk (14)
- # clojurescript (22)
- # community-development (3)
- # cryogen (12)
- # cursive (15)
- # data-science (13)
- # datomic (11)
- # deps-new (8)
- # emacs (3)
- # fulcro (31)
- # gratitude (7)
- # holy-lambda (8)
- # honeysql (6)
- # introduce-yourself (1)
- # jackdaw (11)
- # jobs-discuss (7)
- # kaocha (1)
- # malli (8)
- # other-languages (9)
- # pathom (14)
- # pedestal (1)
- # polylith (3)
- # portal (12)
- # re-frame (3)
- # react (3)
- # reagent (4)
- # releases (3)
- # reveal (7)
- # ring (11)
- # shadow-cljs (17)
- # specter (3)
- # sql (1)
- # timbre (2)
- # tools-deps (122)
- # xtdb (18)
@cddr I want to switch from the jackdaw included avro serde to yours https://github.com/cddr/edn-avro as I had errors with nested lists/maps in jackdaw.
But with union types I always have to specify the union-path when I want to convert from edn to avro.
So I have {:yolo "yolo"}
but need {:yolo {:string "yolo"}}
for the example in your code.
How do you do it? Always "manually" or do you have some code/helper that you can share.
I validate the output with malli so I'm thinking of writing a custom malli transformer but wondering how you handle it and what's the simplest way.
Fortunately I never had to migrate any code from one to the other and the new code I wrote that used edn-avro just used the latter explicitly but I can see how migrating existing code would be annoying
Also, you should probably know I don't actually use this anywhere in production. It was more of an itch I wanted to scratch but haven't yet had the opportunity to use it in a production system.
Hmm, OK. Thanks. I want to write a relatively simple kstreams app that takes messages from one topic and splits them up (depending on some json field) to X other topics. Input is only json, output is avro as I want the data with the s3-connector to end up as parquet in S3. For some avro schemas with nested map in a list in map, jackdaw errors and I was looking for a simpler way than fixing jackdaw and reading your readme made me think that it's maybe better to not use it at all.
I simply get
java.lang.IllegalArgumentException: No implementation of method: :clj->avro of protocol: #'jackdaw.serdes.avro/SchemaCoercion found for class: nil
oh. thanks. Since I have malli schemas for it, shouldn't be hard to transform the output to the json format avro needs. I'll try that.