@xsyn has joined the channel
Hi guys, I’m not sre this is the correct place to ask, I’ve just started using Sparkling, and quite like it as preference over iPython for a Spark interface. One of the things I’ve picked up on is that on doing a spark-sql select that Sparkling uses a single thread (via the repl) while iPython uses all 4 of my cores. My initial thinking is that this could be a couple of things a) An implementation/configuration detail b) Something to do with the repl and being in a lein sandbox c) Some kind of abstraction detail. Can anybody possibly point me in the right direction so that I can dig a little?
@sjharms has joined the channel