Clojurians Log v2
Clojure programming
Channels
Apps
aws 2022-08-04
are there any examples of aws sqs using cognitect aws-api?
I would like to reach out an example for retrieving messages from time to time
(require '[promesa.core :as p])
(defonce consume-sqs-scheduler-running
(atom true))
(def consume-sqs-scheduler
(let [{::keys [event-pull-seconds]} config]
(p/loop []
(p/delay (* 1000 event-pull-seconds))
(when @consume-sqs-scheduler-running
(handle-sqs-data (pull-sqs-data! config))
#_(println ::RUN!))
(p/recur))))
valtteri 2022-08-04T15:09:35.087349Z
SQS client has built-in long-polling support if max 20sec interval is OK for you https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/examples-sqs-long-polling.html
valtteri 2022-08-04T15:09:59.858879Z
Sorry, I don’t have an example how to use that with cognitect aws-api but just wanted to point out this as an option. 🙂
valtteri 2022-08-04T15:11:48.034339Z
Oh wait… cognitect aws-api uses the API directly and there’s no “official” aws-client involved.. So you’ll probably need to build the delay mechanism yourself. Your example with promesa looks like a an OK starting point. It’s very simple and probably works. If you you need something more robust I’d look into quarts (maybe a bit overkill), tea-time or similar scheduler.
valtteri 2022-08-04T15:14:01.032349Z
Or.. since you’re on AWS.. it’s also possible to schedule a lambda to periodically read the queue
👍 1
valtteri 2022-08-04T15:15:48.825229Z
Actually.. it would be kinda interesting if someone has figured out how to do long-polling with cognitect aws-api
Karol Wójcik 2022-08-04T15:37:03.481429Z
I would go for Lambda. Typically you want consume message & dead letter queue. This is very easy to setup with Lambda.
https://github.com/RutledgePaulV/piped is an SQS client implemented with aws-api, might be worth checking out the source code
if it's not possible, I'll do something like this