This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2017-01-22
Channels
- # beginners (10)
- # boot (134)
- # cider (29)
- # clara (2)
- # cljs-dev (10)
- # cljsjs (2)
- # cljsrn (13)
- # clojure (76)
- # clojure-india (4)
- # clojure-ireland (1)
- # clojure-russia (20)
- # clojure-spec (11)
- # clojure-uk (7)
- # clojurescript (88)
- # core-async (5)
- # core-logic (3)
- # cursive (17)
- # datascript (5)
- # datomic (123)
- # hoplon (8)
- # klipse (6)
- # lambdaisland (2)
- # leiningen (4)
- # luminus (2)
- # off-topic (23)
- # om (23)
- # om-next (1)
- # onyx (20)
- # pedestal (2)
- # perun (2)
- # re-frame (11)
- # ring-swagger (3)
- # untangled (12)
Has anyone experienced a problem with the Onyx Amazon S3 that fails when uploading files to paths that don’t exist?
17-01-22 11:24:33 jasebellmacmini.local INFO [onyx.plugin.s3-output:45] - Client request failed CLIENT_REQUEST_FAILED_EVENT
17-01-22 11:24:33 jasebellmacmini.local INFO [onyx.plugin.s3-output:48] - Transfer failed. TRANSFER_FAILED_EVENT
If I upload to a bucket then that works fine along with the naming function. As soon as I want something like /2017-01-01/tweets/twitter-tagname-e02afaacec1f5466d5725fed22982edfcc5bdfe6e1f6a96619264e433ac30.gz
then I get the failed transfer message.I can do this from the aws cli with no issues, just wondering if I was missing something.
@jasonbell To be clear, are you trying to upload a bucket that doesnt yet exist?
@isaac It does, yes.
@michaeldrogalis For example :s3/bucket “mybucket” but then the name function would be (str “/” (f/unparse date-format (t/now)) “/” (:onyx.core/identity event) “.gz”))
for example
@jasonbell I would bet the leading slash is giving it problems.
I’ll give it a go in the morning, 22:50 in the UK. Thanks for the prompt heads up @michaeldrogalis
@jasonbell @michaeldrogalis interesting. I don’t think it matters whether the path exists as long as the bucket exists because s3 keys are the whole path
what Mike is saying about the leading path is probably correct though
Let us know how you go
(in the morning :))
@michaeldrogalis @lucasbradstreet I’ll let you know after I’ve tried it 🙂 (in the morning) 🙂
Sounds good. G'night