Fork me on GitHub
#onyx
<
2016-09-26
>
zamaterian14:09:04

Any reason that sql/upper-bound and sql/lower-bound are not document in onyx-sql information model ?

lucasbradstreet15:09:41

Hmm. No good reason

lucasbradstreet15:09:31

Also needs to be described in the README and the task schema

zamaterian15:09:01

I need to expose the partition-table’s min/max for usage in the one or more lifecycles, will you accept a pull request for this ?

lucasbradstreet15:09:22

Could you expose it through the task map instead?

lucasbradstreet15:09:40

Assuming it passed schema checks, etc

zamaterian15:09:13

I don’t see who I could do that, since the min and max is calculated in in partition-table-by-uuid and partition-table, Unless I always configures lower/upper-bound from outside. As it is now there is now way to exactly to reproduce the result from partition-keys if (the database changes between submits)

lucasbradstreet15:09:24

Unless what you mean is that you want that information in the task map?

lucasbradstreet15:09:32

I mean in the event map

zamaterian15:09:02

correct in the event-map 🙂

timothypratley15:09:24

Is there a kinesis plugin in the pipes (should I copy from kafka?)

lucasbradstreet15:09:31

@zamaterian sure, I’d take PR for that. If you could document the lower and upper-bounds that would be even better

lucasbradstreet15:09:50

@timothypratley not currently in the works, however I’d love for one to exist

zamaterian15:09:05

No problem, will do both 🙂

lucasbradstreet15:09:06

Copying from Kafka would probably be the best bet.

zamaterian15:09:44

Th documentation is that done solely in the information model ?

lucasbradstreet15:09:55

Currently it’s in 3 places, but we will eventually generate them all from the information model.

lucasbradstreet15:09:31

README, onyx.tasks.sql for the task bundle (schema needs those keys added), and the information model

michaeldrogalis15:09:29

I'm going to binge-fix all the plugins one day so their README's are generated from the info model.

michaeldrogalis15:09:37

Probably on a day when Im flying or something.

lucasbradstreet15:09:56

Gotta be done. Getting the info models done was a good first step

lucasbradstreet15:09:06

The formatting is the hard part

michaeldrogalis16:09:22

If anyone wants to contribute, that'd be a great place to help. Granted it's not particularly exciting work, but an important contribution none-the-less.