This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2017-01-31
Channels
- # architecture (5)
- # beginners (35)
- # boot (150)
- # cider (1)
- # clara (7)
- # cljs-dev (131)
- # cljsrn (10)
- # clojure (76)
- # clojure-austin (3)
- # clojure-berlin (1)
- # clojure-brasil (1)
- # clojure-chicago (2)
- # clojure-dusseldorf (1)
- # clojure-italy (30)
- # clojure-nl (2)
- # clojure-russia (40)
- # clojure-serbia (2)
- # clojure-spec (25)
- # clojure-uk (13)
- # clojured (2)
- # clojurescript (106)
- # core-async (29)
- # datascript (65)
- # datomic (38)
- # emacs (8)
- # funcool (8)
- # hoplon (6)
- # jobs (3)
- # klipse (93)
- # luminus (16)
- # lumo (4)
- # off-topic (2)
- # om (11)
- # onyx (13)
- # pedestal (4)
- # protorepl (3)
- # re-frame (40)
- # reagent (31)
- # ring (6)
- # ring-swagger (4)
- # slack-help (5)
- # spacemacs (13)
- # untangled (17)
- # vim (2)
hi all this may be a silly question , but if i want a task to receive a batch of segments , all i should need to do is set the batch-fn property to try right ?
the basic idea is that we are processing segments and then collecting them to be emailed , but the batch task isnt receiving a vector of segments , rather its just recieving individual segments
@rc1140: yep, that's right. Batch fn is what you need. Just make sure you return your data in the way described by the docs
See https://github.com/onyx-platform/onyx/blob/0.9.x/test/onyx/peer/batch_function_test.clj as an example
cool , let me setup a small demo to test with , possibly an issue with code or workflow
i assume the fact that we are reading from and writing to kafka shouldnt change anything
Yup. End result should be the same
is there a way to have an undefined batchsize , i.e just continue sending segments until timeout
so the issue atm is that it if i create a spy function as a test (as defined in the docs) and set it up as a batch function it only prints out single empty values until i kill the job , I have checked the value from the previous task is a vector of maps but the amount of items printed in the spy functions are way more than returned by the previous step
seems like anytime i setup a function as a batch function is recieves empty (or rather 0 length segments)
@michaeldrogalis Have you had any legal issues using Eclipse or GPL license libs in Pyro?
@yonatanel Haven’t, nope.