@borkdude: if you're WDSL uses an old protocol (like RPC/encoded), you're stuck with Axis 1 (painstakingly slow). Otherwise from my research I think Axis 2 is fine.

thanks

type system ain't going to check mutable state :

https://github.com/apache/spark/pull/8929/files

that is a terrible bug that causes data corruption ^

@ghadi: are you using spark?

yeah

not from clojure

same

it's really nice

....until it stabs you in the heart

yeah i'm finding it to be... hot garbage

Parquet is lovely

at least, we're having a lot of trouble operationalizing

ah - havn't looked at parquet. we're using spark streaming in EMR

haven't tried the streaming yet