This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2020-02-14
Channels
- # announcements (4)
- # aws (7)
- # babashka (44)
- # beginners (178)
- # calva (15)
- # cider (3)
- # clj-kondo (15)
- # clojure (139)
- # clojure-dev (8)
- # clojure-europe (2)
- # clojure-italy (2)
- # clojure-losangeles (9)
- # clojure-nl (32)
- # clojure-spec (6)
- # clojure-sweden (1)
- # clojure-uk (27)
- # clojurescript (17)
- # core-typed (116)
- # cursive (26)
- # data-science (1)
- # datomic (14)
- # duct (16)
- # emacs (9)
- # events (1)
- # fulcro (47)
- # jobs (3)
- # juxt (6)
- # keechma (2)
- # malli (59)
- # mid-cities-meetup (8)
- # off-topic (32)
- # pathom (5)
- # reagent (2)
- # remote-jobs (4)
- # rewrite-clj (16)
- # shadow-cljs (14)
- # spacemacs (9)
- # sql (27)
- # tools-deps (37)
- # vscode (7)
Hi I trying to stream the result from aws s3 and process it. What I am trying is something like
(def s3-result (aws/invoke client {:op :GetObject
:request {:Bucket "my-bucket"
:Key "path/to/some/big-file.csv"
:Range "bytes=0-30000" ;; just an example
}))
;; I want to process the file as it come in line-by-line without holding the things in memory
(-> s3-result
:Body)
;;=> this is of the type .BufferedInputStream
I know that the result is available in the :Body
after the request.
Now does anyone know how to do this lazily?aws-api doesn't support streaming yet. https://github.com/cognitect-labs/aws-api/issues/14
@U0ENYLGTA Thanks for the clarification.
You're welcome.
We do plan to support "bring your own http-client" in the future, but there is no timeline for that.
👍 4
[ANN] Cognitect Labs' aws-api 0.8.437 is now available! https://groups.google.com/forum/#!topic/clojure/AIQzOkhUDBU