Fork me on GitHub
#jackdaw
<
2022-01-18
>
Alastair Hole11:01:45

Hi, I’m fairly new to Clojure (looking at alternatives to Erlang/Brod, mainly to be able to use Kafka Streams API). So far I am trying to consume a topic with messages encoded in Avro with Schema Registry integration. Can someone point me at any examples of how to do this? I think I need to use a resolver but I am unsure what is required. I am hoping that it can retrieve the correct schema automatically from the header bytes of the message payload

cddr13:01:28

Hey Alistair There’s some example avro code buried inside a comment in one of the examples in the code https://github.com/FundingCircle/jackdaw/blob/master/examples/serdes/src/serdes.clj#L116

cddr14:01:38

There’s a few rough edges to jackdaw but I think it provides a decent experience for working with kafka streams (though I’m definitely biased towards solutions that allow me to write clojure). It hasn’t quite kept up with the pace of the upstream so sometimes you need to drop down to the java interop level but usually that’s not too much of a problem.

Alastair Hole14:01:26

Thanks @cddr 🙂 Is it possible to provide basic auth credentials to schema registry via Jackdaw? Or would I need to mix in some Java interop?

cddr14:01:54

Yeah I’ve definitely heard of people using the confluent schema-registry (which requires auth) with jackdaw. Lemme see if I have any code snippets