This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2018-02-02
Channels
- # beginners (72)
- # boot (68)
- # cider (51)
- # clara (20)
- # cljs-dev (44)
- # cljsrn (7)
- # clojure (168)
- # clojure-brasil (1)
- # clojure-dev (48)
- # clojure-greece (2)
- # clojure-nl (29)
- # clojure-russia (4)
- # clojure-spec (19)
- # clojure-uk (28)
- # clojurescript (2)
- # cursive (9)
- # datascript (1)
- # datomic (105)
- # dirac (1)
- # docker (2)
- # duct (11)
- # emacs (19)
- # events (1)
- # figwheel (1)
- # fulcro (23)
- # garden (4)
- # graphql (5)
- # hoplon (46)
- # jobs (5)
- # juxt (13)
- # leiningen (6)
- # lumo (12)
- # off-topic (29)
- # parinfer (5)
- # re-frame (7)
- # reagent (6)
- # ring (2)
- # sql (5)
- # yada (6)
@mccraigmccraig your sorted stream joins give me ideas on doing joins on other bits of file munging I do too. I'm excited by @reborg’s parallel work https://github.com/reborg/parallel
+1 p/external-sort
: nice @reborg !
cheers @mccraigmccraig!
@reborg: With p/external-sort
, am I right that it assumes fetchf
returns printable clojure data, and that you’ll need enough RAM to store (( chunk-size-as-str + chunk-size-as-clj-data) * Ncores)
?
So you need relatively small chunks? maybe 10s of mb in size?
Yes @U06HHF230, at the moment is storing chunks assuming edn/text. Somewhat naively perhaps 🙂 It could be relaxed. Do you have a specific use case in mind? That might help to better shape some future work. I'm sure it needs chunk x ncores space, but I don't think the code mandates the two representations in memory at once. I guess it depends from your fetchf. fetchf only contract should be to return something that the comparator can understand. It's true that I'm using "pr" to serialize, something to relax as well.
Morning
I had to change 12 files just to add three fields to a webpage (and these fields are saved in an SQL DB).... :thinking_face::thinking_face::thinking_face:
that seems a little excessive @thomas! i count 6 for a simple field addition in our system: migration, schema||spec, model, view, view-model-subs, view-event-handlers - what else do you have?
Fun and games... Windows update seems to be taking a rather long time to restart. Guessing this is related to an update for Spectre and Meltdown
i had to install windows and visual studio about 5 times each a couple of weeks ago @yogidevbear, searching for the magic combination of versions that would work with cordova... although in the end my problem turned out to be something to do with msbuild not working with vmware or parallels sharing mounts. i am scarred
@mccraigmccraig the page it self, some java code where the data comes from, several DTO's, some factories, an SQL update file and a new class for the list of options.
ah @thomas E_JAVA 😬
big hindsight lol @ DTOs
I don't get them to be honest. But then it isn't entirely clear to me why I'd want to use an ORM in the first place. (I kinda understand what they do, but as documented in plenty of places on the interweb, there is an impedance mismatch)
In case folks hadn’t noticed, it’s State of Clojure survey time: http://surveymonkey.com/r/clojure2018 🙂