Fork me on GitHub
#admin-announcements
<
2015-06-12
>
chrisbetz08:06:18

@tilak, @barton, @jstokes: Hi, just joined clojurians on slack and learned about your course. Would like to here about any comments, because I'm the one behind sparkling.

Tilak11:06:22

@chrisbetz: just started using it. thanks for great library. I'm using this opportunity to learn both Spark & Clojure. My comments/questions so far - parallelize fn does not work with set and map that makes sense as they are not List, they need to be explicitly seq'ed, is there a reason why you choose not to have that conversion logic in parallelize fn? It's easy for beginner to think that all Clojure data structures can be parallelized. And same for parallelize-pairs, does not work with map. Some trivial or not so trivial wrapper fns are missing and I’m planning to add them for Clojure practice - https://github.com/tilakthapa/berkeley-spark/blob/master/src/berkeley_spark/spark.clj, let’s see if I can manage to try all the exercies & labs with Sparkling.

jstokes12:06:24

@chrisbetz: i’ve only played around with a repl in sparkling, but first impressions were great. i’d love to see this carried forward with support for dataframes/mllib that were a part of 1.3/1.4 - then i would be able to make a compelling argument for use at work. i’d be willing to contribute to that cause, i just need to get more up to speed on spark/clojure first

chrisbetz12:06:14

@tilak: Good idea, to spread parallelize to other collections. Will have to check.

chrisbetz12:06:40

@jstokes: Yes, dataframes are the next thing. But I'm a little busy bringing my Spark ETL process to production right now. Just follow me on github, I'll keep you posted.

jstokes12:06:14

great, let me know if i can help out simple_smile

chrisbetz12:06:30

@jstokes: good to know. I'll come back to you simple_smile

Tilak12:06:10

@chrisbetz: @jstokes great, not an clojure expert, but if there is something at beginner level to contribute, i’ll be happy to contribute.

chrisbetz12:06:24

@tilak: thanks for offering. simple_smile I need to check, I'm pretty sure there are things...

chris13:06:36

wouldn’t implicitly calling seq defeat the performance gains of parallelizing? You still have to visit every element in order to create the list

kamillelonek18:06:17

how would you describe leiningen in one sentence?

akiva18:06:15

A Clojure build tool and dependency management system with all the dexterity of a 50x50x50' piece of granite.

arrdem18:06:11

that’s 3.68e6 grams or 4.06 tons

akiva18:06:46

Proof that the Clojure community comes together to help.

arrdem18:06:25

hey I’m waiting for hadoop.. may as well help out right?

akiva18:06:51

Heck yeah.

fogus20:06:18

How does one invite or request to invite someone?

akiva20:06:08

Oh I guess that’s only admins.

gjnoonan20:06:24

@fogus just send the user to http://clojurians.net if they enter their e-mail they will get an invite right away

akiva20:06:38

[takes credit anyway]

gjnoonan20:06:56

@akiva: that link is only shown for admins though 😉

akiva20:06:46

Yeah, I see that now.

fogus20:06:29

BTW, the Call for Presentations for CUFP 2015 is ending in 2 days. http://cufp.org/2015/call-for-presentations.html More Clojurians needed!

fogus20:06:40

Otherwise they'll need to change the conference to "The Galois Show"

gjnoonan20:06:04

hmm 2 days to come up with a talk though!

fogus20:06:07

You don't have a talk available on a moment's notice?!

gjnoonan20:06:12

Well I have an idea “The Immutable Law firm - changing the legal landscape with Clojure and Datomic”

fogus20:06:40

I'd vote for it

seancorfield20:06:56

Ooh, Tony’s on the committee… tempting to submit something very provocative about dynamic languages being better than statically typed languages… 😄