Fork me on GitHub
#onyx
<
2015-11-25
>
surreal.analysis01:11:47

Thanks, I thought I had seen that somewhere

michaeldrogalis01:11:49

Also Breeze EHR, need to get their logo up

surreal.analysis01:11:53

Must have missed it scrolling through

yusup05:11:15

I am seeing retries for segments . It takes 20+ seconds to process a segment. Is this caused by timeout or not being acked ?

yusup05:11:39

I see pending timeout is 60seconds .

yusup05:11:22

there is nothing related to retries in the onyx.log

lucasbradstreet05:11:37

If you're taking 20+ seconds to work on a segment you may either need to increase the pending-timeout (and ack daemon timeout), or decrease your max-pending on your input tasks to reduce the amount of segments that you're processing at one time

yusup05:11:11

In the case of retry, am I gonna be able to see the cause of retry somewhere ? onyx-metrics maybe ?

lucasbradstreet05:11:42

If you use metrics you should be able to look at the batch latency of your tasks and see which tasks are taking the longest

lucasbradstreet05:11:09

The ones that take the majority of the 60s are the ones that are contributing the most to the retry

yusup05:11:42

60s is for one batch ? no for single segment ?

lucasbradstreet05:11:28

Single segment. Each segment at the input task has 60 seconds to be fully processed

yusup05:11:13

Ok. thanks . I have to turn on metrics for the details.

robert-stuttaford14:11:31

@lucasbradstreet: riemann issues were because drum roll the instance’s hdd was full. 2.4gb of logs, written twice to the same disk

lucasbradstreet15:11:41

On the riemann instance?

lucasbradstreet15:11:11

Log rotation / excision. Unsolved (or not) problem in computer science heh. We've all been there huh

michaeldrogalis15:11:16

@robert-stuttaford: +1, been there. Glad you found it.

robert-stuttaford17:11:58

yes on the riemann instance

robert-stuttaford17:11:08

damn thing wrote 2.4gb in a day

robert-stuttaford17:11:20

just checking, guys, how’s that 0.8.1 release looking?

lucasbradstreet18:11:25

It's looking good. I'll release tomorrow

lucasbradstreet18:11:40

If you want to get things ready and tested you can give 0.8.1-alpha6 a go. It'll be very very close to the final release

robert-stuttaford19:11:03

ok, great. will get through that tomorrow. thanks Lucas, you’re a mensch!