Fork me on GitHub
#clojure-uk
<
2018-04-19
>
seancorfield06:04:16

(BTW, this was about the only channel where I left clueless Sean Michael Murphy's messages -- he spammed a bunch of channels and sent unsolicited DMs to a lot of people, so he was deactivated and his messages deleted in most channels)

thomas06:04:17

I hadn't realised he went all over the place like that.

thomas06:04:33

and I agree with your action.

jasonbell06:04:06

Yes I got a DM from SMM, safely ignored.

seancorfield06:04:37

As an Admin, I feel obliged to apologize for his clueless arse... 😞

jasonbell06:04:02

naahhh no need, it happens

👍 16
seancorfield06:04:28

Y'all are gracious 🙂

yogidevbear07:04:59

Morning gracious people ☀️ simple_smile

yogidevbear07:04:24

Think I might have to go for a run today

otfrom07:04:22

@seancorfield moderating is hard. thx for doing it.

💯 12
👏 16
alexlynham07:04:48

morning morning

alexlynham07:04:42

close to falling asleep pre-coffee as for some reason I wanted to make kafka run in travis to run integration tests troll 💤

thomas08:04:06

can I just say that React is quite a pain to use IMHO...

thomas08:04:33

I wish I could do reagent/re-frame 🤯

mccraigmccraig08:04:18

what's stopping you @thomas?

thomas08:04:40

I don't get to decide.... this project is using react and is already in production.

mccraigmccraig08:04:04

maintenance is a thankless job 😬

alexlynham08:04:50

has anybody here used or experimented with Kinesis?

thomas08:04:33

I don't particular like it.... doing some new function at the moment... but still need to understand how some of it works.

otfrom08:04:58

we're using kinesis (but again, I'm not the one who gets angry with these things)

jasonbell09:04:39

@alex.lynham Once you accept how it works, how you can't tune it and how the consumer per shard allocations work, then it's good. I prefer Kafka and @otfrom knows I get angry about these things like lack of partition calculations, disk i/o tuning, broker RAM/message ratios and stuff like that. 🙂

guy12:04:40

afternoon all

alexlynham12:04:46

@jasonbell but you guys are also using kafka right? What's the calculation that makes you prefer one or the other

jasonbell12:04:11

@alex.lynham I have my own reasons. I am though happy to use what works for the delivered solution in hand.

jasonbell12:04:32

So I'm happy with both as long as you aware of the caveats you need to keep in mind.

guy12:04:01

well i better go then

guy12:04:04

see ya tmw 😄

alexlynham12:04:53

right, and caveats are mainly about control of the platform at a configuration level I guess

alexlynham12:04:58

and maybe the persistent log?

jasonbell12:04:16

@alex.lynham Either way I'd be looking to sink out all data to S3 somehow. I prefer to keep my Kafka logs not too big either. All depends on the use case. Kafka Connect has made that a lot easier, I used to write Kafka Streams to dump to S3 on a separate consumer group.

alexlynham13:04:12

right, so you're not a fan of infinite logs then I take it? As far as I can tell, besides tunability that's the Kafka USP (maybe connect too, for legacy systems? idk)

alexlynham13:04:52

other people I've talked to are often dumping out kafka results into s3 artifacts tho - what serialization/file format are you using?

otfrom14:04:05

we're using baldr

otfrom14:04:23

(with different payloads inside - sometimes json and sometimes nippy)

otfrom14:04:17

tho other formats might work better depending on what you want to do with it and what your performance demands are

mccraigmccraig14:04:20

anyone here an awk guru perchance ?

jasonbell15:04:40

awk '{ gsub("yes","no",$1); print $1 }'

jasonbell15:04:17

@mccraigmccraig Sadly I still Google awk things

otfrom15:04:57

I only use awk for splitting lines into fields by delimiter

mccraigmccraig18:04:17

anyone interested in scripts to snapshot/restore cassandra keyspaces scalably with sstableloader - including between different clusters and restoring to a different keyspace ? @otfrom ?

otfrom21:04:51

I would. I'm not sure I'd use it atm. We're not running any c*right now