Clojurians Log v2

Clojure programming
Channels
# 100-days-of-code# _silence# aatree# admin-announcements# adventofcode# ai# ai-skeptics# alda# aleph# all-the-channels# announcements# arachne# architecture# asami# atlanta-clojurians# atom-editor# autochrome-github# avi# aws# aws-lambda# babashka# babashka-sci-dev# bangalore-clj# beginners# berlin# biff# bigdata# bitcoin# boot# boot-dev# boulder-clojurians# braid-chat# braveandtrue# brevis# bristol-clojurians# business# calva# capetown# carry# catalyst# cbus# cestmeetup# cherry# chestnut# chlorine-clover# chrondb# cider# circleci# clara# clerk# clj-commons# clj-http# clj-http-lite# clj-kondo# clj-on-windows# clj-otel# clj-together# clj-yaml# cljdoc# cljfx# cljs-dev# cljs-experience# cljsfiddle# cljsjs# cljsrn# clojars# clojure# clojure-android# clojure-argentina# clojure-art# clojure-austin# clojure-australia# clojure-austria# clojure-bangladesh# clojure-bay-area# clojure-beijing# clojure-belgium# clojure-berlin# clojure-boston# clojure-brasil# clojure-canada# clojure-chennai# clojure-chicago# clojure-china# clojure-colombia# clojure-conj# clojure-czech# clojure-denmark# clojure-denver# clojure-derby# clojure-dev# clojure-doc# clojure-dusseldorf# clojure-ecuador# clojure-egypt# clojure-estonia# clojure-europe# clojure-filipino# clojure-finland# clojure-france# clojure-gamedev# clojure-germany# clojure-greece# clojure-guangzhou# clojure-hamburg# clojure-hk# clojure-houston# clojure-hungary# clojure-india# clojure-indonesia# clojure-ireland# clojure-israel# clojure-italy# clojure-japan# clojure-kc# clojure-korea# clojure-losangeles# clojure-madison# clojure-mexico# clojure-miami# clojure-mk# clojure-mke# clojure-morsels# clojure-my# clojure-new-zealand# clojure-nl# clojure-nlp# clojure-norway# clojure-ohio# clojure-poland# clojure-portugal# clojure-provo# clojure-quebec# clojure-romania# clojure-russia# clojure-sdn# clojure-seattle# clojure-serbia# clojure-sg# clojure-shanghai# clojure-spain# clojure-spec# clojure-survey# clojure-sweden# clojure-switzerland# clojure-taiwan# clojure-turkiye# clojure-uk# clojure-ukraine# clojure-za# clojurebridge# clojurebridge-ams# clojurecup# clojured# clojuredesign-podcast# clojureindia# clojureremote# clojurescript# clojurescript-ios# clojuresque# clojureverse-ops# clojurewerkz# clojurewest# clojurex# clojurian-chat-app# clojutre# cloverage# cloxp# clr# code-art# code-reviews# component# conf-proposals# conjure# consulting# contributions-welcome# copenhagen-clojurians# core-async# core-logic# core-matrix# core-typed# cryogen# crypto# css# cursive# cz-clojure# d2q# data-oriented-programming# data-science# datacrypt# datahike# datalevin# datalog# datascript# datavis# dato# datomic# defnpodcast# deps-new# dev-tooling# devcards# devops# dirac# docker# docs# domino-clj# duct# dunaj# eastwood# editors# emacs# error-message-catalog# etaoin# ethereum# euroclojure# events# exercism# expound# figwheel# figwheel-main# flambo# fulcro# funcool# functionalprogramming# funimage# garden# ghostwheel# girouette# gis# google-cloud# gorilla# graalvm# graalvm-mobile# graclj# graphql# gratitude# gsoc# guix# hammock-driven-dev# helix# heroku# hispano# holy-lambda# honeysql# hoplon# hugsql# humbleui# humor# hypercrud# hyperfiddle# immutant# improve-getting-started# incanter# indycljs# inf-clojure# instaparse# integrant# interceptors# interop# introduce-yourself# iot# iotivity# ipfs# jackdaw# jaunt# java# javascript# javelin# jobs# jobs-discuss# jobs-rus# joker# joyride# jukebox# juxt# jvm# kaocha# keechma# kekkonen# keyboards# klipse# kosmos# lambdaisland# lazytest# ldnproclodo# lein-figwheel# leiningen# liberator# lingy# liquid# livestream# local-first-clojure# london-clojurians# lsp# luminus# lumo# mail# make-a-clojure# malli# matcher-combinators# mathematics# matrix# meander# melbourne# membrane# membrane-term# mental-health# microservices# mid-cities-meetup# midje# minecraft# missionary# monads# mount# mranderson# music# nbb# new-channels# new-clojure# nextjournal# nginx# nrepl# numerical-computing# nyc# obb# observability# off-topic# om# om-next# omni-trace# onyx# other-languages# other-lisps# overtone# pamela# parinfer# pathom# pedestal# pegex# perun# philosophy# phzr# planck# plastic# play-clj# podcasts-discuss# polylith# pomegranate# portal# portkey# portland-or# powderkeg# practicalli# precept# prelude# programming-beginners# proletarian# proton# protorepl# pulsar# pure-frame# qa# qlkit# quil# random# rdf# re-frame# react# reactive# reading-clojure# reagent# reclojure# reitit# releases# remote-jobs# rephrase# respo# rethinkdb# reveal# rewrite-clj# ring# ring-swagger# robots# rum# schema# sci# scittle# sfcljs# shadow-cljs# signaali# sim-testing# sioux-falls# slack-help# sneer# sneer-br# spacemacs# spam-reports# specmonstah# specter# speculative# spirituality-ethics# sql# squint# startup-in-a-month# sydney# test-check# test-doc-blocks# test200# test345# testify# testing# thejaloniki# timbre# tmp-json-parsing# tools-build# tools-deps# trading# transit# tree-sitter# uncomplicate# unrepl# untangled# utah-clojurians# videos# vim# vrac# vscode# wasm# web-security# windows# xtdb# yada# yaml# yamlscript# yleinen
Apps

jackdaw

2021-07-29T09:40:39.032100Z

Hello, Anyone with experience in consume batch of messages from Kafka could give me some help ? I need to consume a batch of messages from Kafka and save it in a MongoDB database avoiding duplicates. Is there a simple way to develop a consumer like that ? Any code examples would be nice ?

dbernal 2021-07-29T13:38:06.032200Z

Have you looked into Kafka Connect for MongoDB? https://docs.mongodb.com/kafka-connector/current/

2021-07-29T14:30:04.032500Z

Hello @dbernal, Thanks for the tip. I was considering Kafka Connect. But then I realized that I have to do some transformation in two fields from the message I read from kafka, and I don't know if I can do that using SMT.