Fork me on GitHub
#jackdaw
<
2021-10-06
>
jjttjj17:10:48

Attempting to get jackdaw working with confluent cloud. Is there something obviously wrong with this:

<config setup>
Edit: figured it out, was using the wrong keys

jjttjj20:10:26

I'm trying to copy/paste the serdes example but using deps.edn for my project and I keep getting the error

2021-10-06T20:09:14.980Z DESKTOP-O6G07JE ERROR [org.apache.kafka.streams.KafkaStreams:489] - stream-client [serdes-f9c3b089-68fc-42f1-8209-322ba909291b] Encountered the following exception during processing and the registered exception handler opted to SHUTDOWN_CLIENT. The streams client is going to shut down now. 
                             org.apache.kafka.streams.processor.internals.StreamThread.run              StreamThread.java:  556
                         org.apache.kafka.streams.processor.internals.StreamThread.runLoop              StreamThread.java:  583
                         org.apache.kafka.streams.processor.internals.StreamThread.runOnce              StreamThread.java:  720
                       org.apache.kafka.streams.processor.internals.StreamThread.pollPhase              StreamThread.java:  885
                    org.apache.kafka.streams.processor.internals.StreamThread.pollRequests              StreamThread.java:  925
                                      org.apache.kafka.clients.consumer.KafkaConsumer.poll             KafkaConsumer.java: 1206
                                      org.apache.kafka.clients.consumer.KafkaConsumer.poll             KafkaConsumer.java: 1226
          org.apache.kafka.clients.consumer.KafkaConsumer.updateAssignmentMetadataIfNeeded             KafkaConsumer.java: 1257
                      org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.poll       ConsumerCoordinator.java:  508
         org.apache.kafka.clients.consumer.internals.AbstractCoordinator.ensureActiveGroup       AbstractCoordinator.java:  365
         org.apache.kafka.clients.consumer.internals.AbstractCoordinator.joinGroupIfNeeded       AbstractCoordinator.java:  425
         org.apache.kafka.clients.consumer.internals.AbstractCoordinator.initiateJoinGroup       AbstractCoordinator.java:  503
      org.apache.kafka.clients.consumer.internals.AbstractCoordinator.sendJoinGroupRequest       AbstractCoordinator.java:  546
                  org.apache.kafka.clients.consumer.internals.ConsumerCoordinator.metadata       ConsumerCoordinator.java:  222
org.apache.kafka.streams.processor.internals.StreamsPartitionAssignor.subscriptionUserData  StreamsPartitionAssignor.java:  258
           org.apache.kafka.streams.processor.internals.assignment.SubscriptionInfo.<init>          SubscriptionInfo.java:   90
                  org.apache.kafka.streams.internals.generated.SubscriptionInfoData.<init>      SubscriptionInfoData.java:  142
                                                           java.lang.ClassLoader.loadClass               ClassLoader.java:  522
                                 jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass              ClassLoaders.java:  168
                                          jdk.internal.loader.BuiltinClassLoader.loadClass        BuiltinClassLoader.java:  606
java.lang.ClassNotFoundException: org.apache.kafka.common.Uuid
  java.lang.NoClassDefFoundError: org/apache/kafka/common/Uuid
When I try to start the code (https://github.com/FundingCircle/jackdaw/blob/2d1b0a0f2ba860f62a651985794ae5bd3792e136/examples/serdes/src/serdes.clj#L105) Anyone know what this might be? My current guess is that it's a dependency issue

jjttjj20:10:45

Ah, sorry, I keep answering my own questions immediately after I finally give up and ask here. I fixed the above by manually adding deps like this

org.apache.kafka/kafka-streams {:mvn/version "2.8.0"}
  org.apache.kafka/kafka-clients {:mvn/version "2.8.0"} 
  fundingcircle/jackdaw {:mvn/version "0.8.1-drop_clj_time-SNAPSHOT"
                         :exclusions [org.apache.kafka/kafka-clients]}