This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2017-05-28
Channels
- # beginners (67)
- # boot (31)
- # cider (1)
- # cljs-dev (12)
- # cljsjs (1)
- # cljsrn (23)
- # clojure (86)
- # clojure-russia (2)
- # clojure-spec (6)
- # clojure-uk (12)
- # clojurescript (171)
- # core-async (2)
- # core-matrix (1)
- # cursive (3)
- # events (1)
- # lumo (6)
- # off-topic (118)
- # om (51)
- # onyx (16)
- # perun (3)
- # re-frame (14)
- # reagent (19)
- # uncomplicate (5)
- # unrepl (6)
- # untangled (6)
how would the uuid thing even work in the current setup ? it’s pretty much impossible to define ranges in the same way we do for the non-uuid case, so all i can think about is something similar to what used to be in place
Uuids are evenly distributed, so the main factor will be the chunk size. Otherwise I think we can do the same thing. I could be wrong though
hmmm right, but that would still include the awkward count(*)
to figure out the total size, so we can calculate the # chunks based on that
if we want to keep it the most simple, it would just ask for the # of chunks, rather than the chunk size
That would be simplest
@lucasbradstreet well, apart form some escaping issues for the jsonb
format, the proof of concept is working! i’ll need to tidy this up big time though, but expect an incoming patch somewhere next week
@lmergen Nice! 🙂
might need some help with optimizing this somewhere down the road, my java-fu is not that great, and i think i’m doing too much copying
@lmergen Hah, good place to be. Yeah we can help with that for sure.
hi, i have a “101” question. I’m trying to figure out the best way to build/debug workflows. For instance, i’m pulling from datomic with read-log. I’d like to dump/inspect the segments that are read to help me craft the functions for the subsequent stages
@eoliphant I dont know if its the best answer but i make an spy function. like this:
{:onyx/name :read-log
:onyx/plugin :onyx.plugin.datomic/read-log
:onyx/type :input
:onyx/medium :datomic
:datomic/uri (env :database-url)
:datomic/log-start-tx (:datomic/log-start-tx (env :config-onyx))
:datomic/log-end-tx nil
:checkpoint/key :t
:checkpoint/force-reset? false
:onyx/max-peers 1
:onyx/fn ::spy
:onyx/batch-size 10
:onyx/doc "Reads a sequence of datoms from the d/datoms API"}
(defn spy [segmento] ... )