hi @aaelony, have you increased aeron.socket.so_sndbuf and aeron.socket.so_rcvbuf for aeron previously ?

so... today is tomorrow already, what's the news? :-))

We are thinking of changing our workflow up a little and I wanted to see if this is a good idea or not. The last stage of our current workflow is a window/trigger. This trigger right now is doing a hell of a lot of stuff and potentially more in the future. The reason is we are collapsing records based on a key and we don’t need to do all of this work on every segment but just this final collapsed segment. My thought was to remove a lot of this from the trigger by sending the collapsed segment back into a kafka topic which would then be backed up by a secondary :in task to finish off the workflow. Does this sound like a good idea ? or is there a better approach?

Right now that's the only way to do sequential aggregations, we have some folks using that approach.

@lucasbradstreet @michaeldrogalis have you guys shared your big announcement yet? 🙂

Not yet, gotta let hype build first (heh, not really, just finishing the blog post)

well now i am excited

lol

@gardnervickers: Thnx for the input, just wanted to make sure that sounded reasonable

I thought i read about some one else using that approach once before

@asolovyov @robert-stuttaford My "tomorrow" gets later and later every day. Thing about working for yourself is that you get sucked into working really late at night when it's quiet. 🙂

kind of like that silicon valley episode with the datacenter “ Day and Night are all kind of the same thing down here” lol

Haha. Yeah pretty much. I get a reasonable amount of sleep, but I'm busy for sure.

@michaeldrogalis: i totally know what you mean. i've been working from home for over a decade, so i've since cycled back out of that (ultimately) negative pattern. enjoy it while you can manage it 🙂

@robert-stuttaford: Wise man. You've walked many miles on my path. 🙂

@mariusz_jachimowicz: yes, I did.

The big news is out. We just closed a seed round to build a managed platform on top of Onyx.

http://www.onyxplatform.org/jekyll/update/2016/08/17/Funding.html

Awesome news guys

Now I wish I could show what we've already built. 🙂 That's going to be a few more months though.

this is definitely good stuff.

Awesome, really glad for you! Looking forward to see what's coming

Its beautifully unique 🙂

that it is. I still want to bring you guys on for some one on one. Waiting for some stuff to finalize and hopefully this can be accomplished

congratulations, @michaeldrogalis and @lucasbradstreet. hugely deserved!

@michaeldrogalis: congrats on the seed round! great to see open source projects with a clear path to monetization

Awesome, thanks! Everything is a balance game now. I've been heads-down on the product for a few months now, hence why I had to slow up on Onyx core a little. Lucas is still 98%+ Onyx dedicated though

We'll keep switching back and forth into the fall

Thanks @lmergen @robert-stuttaford!

I can definitely say that we've built something already that will let you shuttle data between all the existing plugins at way faster engineering speeds with the same flexibility and high performance you have today in Onyx core.

That's great! Does that mean you're going the Meteor.JS route ?

Making it trivial to develop, and start charging money for production use, that is

Yep. It's a metered-usage platform. Only pay for what you use. Feels pretty similar to AWS.

Is it going to be compute-only, or is there also going to be a data storage offering ?

@michaeldrogalis , @lucasbradstreet congratulations!

@lmergen: Storage will be included, yup.

It's designed to be holistic if you want it, or piece-meal if you want to interconnect with your existing environment.

Thanks @vijaykiran!

(User guide upgrade still on my radar 🙂 )

🙂 no worries, I see that you are busy

So how are you going to handle issues of data locality, where I want my data to be available in, say, Azure data centers ?

I'm probably asking too many questions :)

@lmergen: Lots of work to be done 🙂

Yeah, I imagine. Good luck with this, it must be exciting!

Thanks! 🙂

michaeldrogalis: (/◔ ◡ ◔)/ congrats on the funding!

@otfrom: Thanks buddy 🙂

Well gosh, now I want to start leaking screen shots of our product.

doooo iiiiit

Heh, might actually get in trouble for that one. We'll have a beta out pretty soon.

ask for forgiveness later...

The hugs are what throws people off, huh?

the hugs are part of the corrupting influence.

actually, I'm pretty sure everyone on #C064BA6G2 would agree w/that 😉

Hah

so... <sekrit product> : onyx :: AWS EMR : hadoop ?

@otfrom: It's like a super-charged environment for using Onyx end-to-end. Everything's just faster to figure out and debug.

cool