Fork me on GitHub

Hello, Anyone with experience in consume batch of messages from Kafka could give me some help ? I need to consume a batch of messages from Kafka and save it in a MongoDB database avoiding duplicates. Is there a simple way to develop a consumer like that ? Any code examples would be nice ?


Have you looked into Kafka Connect for MongoDB?


Hello @U2JACTBMX, Thanks for the tip. I was considering Kafka Connect. But then I realized that I have to do some transformation in two fields from the message I read from kafka, and I don't know if I can do that using SMT.