google-cloud 2017-02-23

there's definitely alearning curve

however, I'm converted, untangled is amazing

Well once my librarying work is done, there’s no reason I or someone else can’t make an untangled template.

Anyone done dataflow work? Specifically into BigQuery?

Mobileink is already there: his stuff is already decomposed out of template land into libraries.

@domparry haven’t used dataflow for that. I did have a GAE entity post-put hook that added information into a JSON file in GCS that went into BQ at the end of the day.

Worked slick

I have Dataflow reading Pubsub into BQ. Works so well except for one very specific case.

The error I get is: failed_precondition: Record leaf types are not supported.

I’m using a clojure wrapper for dataflow called datasplash (It’s fantastic)