@michaeldrogalis, fwiw my optimism about pre-compiling onyx-local-rt for the tutorial is now somewhat tempered. Turns out the approach I thought could significantly reduce the downloaded JS asset size (and yield better perceived UI responsiveness) leads to a catch-22 with cljs compiler optimizations. Will explore the Klipse-based approach next.

@colinhicks Thanks for digging in 🙂

Here's a super-bare-bones pre-compiled runtime example. https://colinhicks.github.io/onyx-tutorial-ideas/resources/public/index.html

@colinhicks cool. Looks good, especially because changing the function seems to work nicely 🙂

@michaeldrogalis you’ve started something pretty damn cool with this 🙂

@colinhicks Wonderful! 🙂

@robert-stuttaford I'm very excited to see where this goes.

@colinhicks what is your trick for code evaluation? are you using cljs.js/eval-str?

exactly. https://github.com/colinhicks/onyx-tutorial-ideas/blob/master/src/onyx_tutorial/core.cljs

I'm thinking the tutorial will be centered around leveraging Onyx's data-driven API. So, apart from creating/editing user-defined functions, tutorial-takers will mostly be manipulating data structures.

For a given data structure, we can run Onyx's validations independently to say for example: "Your workflow has cycles. Currently Onyx supports only directed acyclic graphs."

@michaeldrogalis @lucasbradstreet et al. , I'm going to integrate a react lib next. What is your preference between om.next/rum/reagent?

We're on Om.next. Pretty happy with it.

Happy to use Reagent if you prefer it, though.

Cool. Om it is.

A good, interactive tutorial will be really big. Im excited.

but then hang once it goes back into the inner loop the second time.

@kingoftheknoll What is defstate?

Mount, lets you do lifecycle stuff like component does

Just with vars instead of records.

Been a while since I looked at Franzy, but I think you need to commit and acknowledge the records you polled for if you have that turned on

Just a guess though

I would think that if I didn't commit an offset if would read from the beginning again. I'll give that a try. Not a whole lot of docs around this part just lots of mentions that he uses core.async and manifold but doesn't say how.

I'll keep poking around :thinking_face:

@kingoftheknoll What exactly is your output?

Logs outer, then inner for the 5 records in topic, outer, inner then stops

Sorry on mobile for the next few min forgive the formatting.

@kingoftheknoll You might want to try Kinsky, we haven't seen the maintainer of Franzy around for a long time, not sure where he went - https://github.com/pyr/kinsky

Fortunately we dont have to touch the Kafka code all that much, but if I were using Kafka for application level code, I probably wouldnt use it tbh.

oh this is great, I haven’t come across this one in my search.

@kingoftheknoll Do you see "Got a value in this loop" at all from the channel consuming loop?

(when (seq records) (>! channel (first records)) (recur (rest records)))) ;;-> will this ever terminate? If it doesn't respond to (seq records), your else clause might be hanging up here?...

The records is not a list or vector but it appears it implements ISeq. I’ll have to dig into it more. I’m not hard set on using Franzy so I’ll check out kinsky as well.

Thanks for helping out. Onyx is the only library I know of that publicly uses kafka so I really appreciate it. BTW love Onyx and the work you’re doing. I can’t wait to use it for something!

@kingoftheknoll 🙂

I’m slowly working on adding a “how to write aggregations” lesson for learn-onyx. My hope is to have it culminate in writing a simple anomaly aggregation function similar to what https://flink.apache.org/news/2016/04/06/cep-monitoring.html does. Hopefully the last piece of the puzzle i need in order to create a rough draft of this is to understand what these log functions do

(defn set-value-aggregation-apply-log [window state v]
  ;; Log command is not needed for single transition type
  v)

probably should read over this… http://www.onyxplatform.org/docs/user-guide/0.9.11/#aggregation-state-management

@drewverlee Yes, the explanation is in that section of the guide.

FYI I fixed the colorization of code examples in the User Guide. Forgot a gem install along the way.

Sorry about that.