Fork me on GitHub
#gorilla
<
2017-08-07
>
xsyn07:08:30

Hi guys, I’m not sre this is the correct place to ask, I’ve just started using Sparkling, and quite like it as preference over iPython for a Spark interface. One of the things I’ve picked up on is that on doing a spark-sql select that Sparkling uses a single thread (via the repl) while iPython uses all 4 of my cores. My initial thinking is that this could be a couple of things a) An implementation/configuration detail b) Something to do with the repl and being in a lein sandbox c) Some kind of abstraction detail. Can anybody possibly point me in the right direction so that I can dig a little?