Fork me on GitHub
#boot
<
2015-06-17
>
martinklepsch07:06:52

Btw, are they any thoughts on task parallelism? Don't need it but would be nice for sure :)

micha13:06:27

@martinklepsch: the problem with running tasks in parallel is not the mapping, it's the reducing

micha13:06:50

@martinklepsch: for example, suppose tasks A, B, and C run in parallel

micha13:06:08

we can fan out very easily, just pass the initial fileset to A B and C

micha13:06:18

so they compute 3 filesets

micha13:06:33

how to merge them now? how to resolve conflicts?

martinklepsch13:06:24

yeah, that was kind of what I was getting at with the question. Mapping is trivial but reduction not so much. Still probably doable with some proper constraints, right?

micha13:06:39

yes, that's a good point

micha13:06:59

if you're doing it you should do it carefully and know what you're doing

martinklepsch13:06:11

i.e. tasks executed in parallel are limited to a certain scope (read subdir) in the fileset

micha13:06:29

i think the conflict resolution part of the git model precludes any kind of automatic parallelization

micha13:06:49

that's an interesting idea

martinklepsch13:06:01

I’m thinking just separating them might be fine in many cases, i.e. stylesheet + cljs compilation

micha13:06:02

kind of like transients or something

micha13:06:54

we can make map and reduce combinators you can use in a pipeline pretty easily i think

micha13:06:18

(defask dev [] (comp (foo) (bar) (parallel merge-fn (css) (cljs)))

micha13:06:24

something like that perhaps?

micha13:06:57

(defask dev []
  (comp
    (foo)
    (bar)
    (parallel merge-fn 
      (comp (css) (garden))
      (cljs))))

meow13:06:25

Might be worthwhile to list the typical use cases for parallel tasks to see which of them need merging and which ones, like the case of stylesheet + cljs compilation, simply need to run to completion.

micha13:06:01

i think they all need some degree of merging

micha13:06:57

i think i agree with the ember guys with their broccoli tool

Slackbot13:06:57

I think you mean team...

micha13:06:14

no, slackbot i don't

meow13:06:30

broccoli team ftw!

micha13:06:32

guys and dudes omg pronouns

Slackbot13:06:32

I think you mean team...

meow13:06:46

guys and gals

Slackbot13:06:46

I think you mean team...

meow13:06:57

silly slackbot

micha13:06:29

anyway the broccoli guys found that parallization isn't a significant improvement when you have pervasive and intelligent caching at the task level

Slackbot13:06:29

I think you mean team...

micha13:06:37

which we have with boot

micha13:06:45

i.e. boot tasks handle their own caching

micha13:06:04

so they are very good at ignoring things that don't need to be recompiled

micha13:06:48

the broccoli guys found that parallelization is most useful when work is being done more than once

Slackbot13:06:48

I think you mean friends...

micha13:06:57

oops, i didn't see martinklepsch set that

micha13:06:02

sorry about that

micha13:06:08

i thought it was a slack thing

martinklepsch13:06:11

No worries 😄

martinklepsch13:06:45

I set that up after seeing it in another Slack and thought it’s a nice idea given that we often use words guys like guys, effectively (sometimes unconsciously) discriminating other genders, I think the auto messages are stupid though. They don’t give that kind of context.

micha13:06:33

i get it, i'm just put off by all the melodrama around the whole issue

micha13:06:53

so i go into automatic snarky mode

akiva13:06:25

And sometimes I actually mean ‘guys’.

martinklepsch13:06:25

Yeah, sometimes I am too. No offense taken simple_smile

micha13:06:34

it's part of my tadschlagargument style i guess simple_smile

martinklepsch13:06:47

@akiva: yeah, that’s another point where @slackbot fails

martinklepsch13:06:11

is broccoli what ember is using btw?

martinklepsch13:06:21

didn’t know.

martinklepsch13:06:52

@micha: @akiva for what it’s worth in that particular case: the lead dev of broccoli is actually not a guy 😉

danielsz16:06:24

Ha, I’ve tweeted this earlier today.

danielsz16:06:38

alandipert: +1

danielsz16:06:32

alandipert: Normally I’ve always got a couple of favorites on my tweets. This one didn’t garner a single one. Sad.

danielsz16:06:06

micha: that’s the spirit!

micha16:06:14

we need a hummus emoticon

danielsz16:06:51

micha: haha, I was looking for a coconut

danielsz16:06:07

but yeah, we need a hummus one

micha16:06:27

man, no coconuts!?

micha16:06:34

this must be rectified

micha16:06:44

🌴 close but no cigar

danielsz16:06:58

🍸 close but no coconut

micha16:06:19

🎳 almost coconuts

micha16:06:27

🌴 🎳

alandipert16:06:26

behold: 🥥

micha17:06:45

holy 🥥

micha17:06:51

thanks alandipert

arrdem17:06:13

deraen: #C03RZRRMP is that way

micha17:06:25

deraen: man i'd love to go to that

juhoteperi17:06:46

No off-topic here? 😞 I'm too used to IRC

micha17:06:18

traffic is so low in here it should be alright, no?

arrdem17:06:22

yeah it's fine, just there are people over in #C03RZRRMP who may be interested 😛

juhoteperi17:06:47

Yeah I just wanted to share it here first as I know Micha and Martin would be interested

akiva19:06:15

And yeah, it’s kind of nice/irritating to have everything dumped into one IRC channel.

danielsz19:06:14

🥥 Wow alandipert !

danielsz19:06:19

deraen: Thanks for letting us know about the Clojutre event. I submitted my proposal. What does "Vastauksesi on tallennettu” mean?

juhoteperi19:06:47

danielsz: Heh. "Your response has been saved". I'll fix that.

martinklepsch19:06:48

@juhoteperi: Berlin ✈️ Tampere sucks big time. Do you know how long does a train from Helsinki takes? (and what’s the price?)

juhoteperi19:06:54

@martinklepsch: 1:15 and about 30€

martinklepsch19:06:40

Oh. I was thinking it’d take 5hrs or so but yeah, now that I look at the map 😄

juhoteperi21:06:47

Boot-livereload is now pushed to Clojars

juhoteperi21:06:35

@podviaznikov: There was a nice side-effect from using metadata for posts metadata, dates are now Date objects

martinklepsch21:06:16

@juhoteperi: do ClojurTRE tickets go fast usually or can I take a week or two to consider things?

podviaznikov21:06:48

@juhoteperi: yep, I noticed that too

juhoteperi21:06:56

@martinklepsch: They are going fast, but I'm sure there will be enough (we have quite large venue this year).

danielsz22:06:44

podviaznikov: I was going through the source code of perun, and I was wondering about the usage of unquote on regular function arguments, as in (io.perun.ttr/calculate-ttr ~metadata).

danielsz22:06:28

Or (io.perun.sitemap/generate-sitemap ~(.getPath tmp) ~files-metadata ~options))

danielsz22:06:36

what’s going on here?

danielsz22:06:18

deraen: you know something about that?