Fork me on GitHub
#onyx
<
2016-09-21
>
michaeldrogalis02:09:11

@aaelony Might've needed a lein clean to fix that -- Clojure version didn't have any affect on it.

aaelony04:09:56

likely right, though I had lein cleaned a few times as well.

michaeldrogalis15:09:02

@lucasbradstreet @smw About adding a new task map parameter to support functions that take the entire batch of segments as an argument, I think @lucasbradstreet's idea was right the first time. Let's deprecate :onyx/bulk? and introduce :onyx/batch-fn?. This is a much better replacement so long as the return value of a fn with :batch-fn? true is a vector than can either be a segment or a vector of segments. That'll cover it 1-1.

lucasbradstreet16:09:32

Cool, I think the side effect use case of :onyx/bulk? is handled by just splitting to two tasks anyway (split to the batch-fn? task, and the task that it would have flowed on to after)

michaeldrogalis16:09:39

Hm? I don't follow that. I believe you'll get the same effect as bulk? by simply returning the original args.

lucasbradstreet16:09:47

Yeah, sorry, that’s true too

lucasbradstreet16:09:18

Cool, I agree that deprecating bulk is the way to go

michaeldrogalis16:09:08

Let's move forward with that then, unless someone has a better name than :onyx/batch-fn?. We considered :onyx/batch?, :onyx/coalesce and :onyx-batched-args?

lucasbradstreet16:09:46

@michaeldrogalis I don’t like any of those, maybe :onyx/fn-batch?, but probably not

michaeldrogalis16:09:59

Wasn't batch-fn? your idea? Heh.

lucasbradstreet16:09:01

I mean any other than batch-fn?

michaeldrogalis16:09:53

Oh. Yeah, Im alright with batch-fn?

michaeldrogalis17:09:26

We will need to update the User Guide and learn-onyx. There's a challenge using :bulk? in there.

lucasbradstreet17:09:38

Didn’t think of that one

michaeldrogalis17:09:40

Ill take care of updating learn-onyx when it's ready to go.