Morning

Mornin'

How's it going @seancorfield?

Let's just say that we're about 11 hours into a database cutover and our hosting company now has Russian engineers from Percona on the call, debugging memory issues with the new servers.

So I've had better days 👀

I hope your morning goes better @dominicm 🙂

@seancorfield That doesn't sound fun. What's the definition of a cutover migration? Google wasn't particularly enlightening.

We have moved from a cluster of servers running Percona 5.5 to a new, smaller-but-faster virtualized cluster running Percona 5.7.

The two version jump meant the hosting company had to seed the DB onto a new 5.6 box and then setup replication in a daisy chain into the new cluster.

We have been working on this process for about five months, testing everything as we went, so we had expected the production cutover to be somewhat smoother.

Could be bugs in Percona 5.7, could be configuration problems. At least it's not application-level problems so it's sort of "not our problem" (except for having to work with the hosting company coordinating restarts so they can debug the problems!).

mogge

@seancorfield - Ouchie! hope it gets sorted soon!

Morning everyone 🙂

morning

Morning beautiful people

what about me?

you don’t count yourself as a person/people? 😞

Since when do you need to create an account on Oracle to download a JDK for Windows? Another nail in the coffin. 🐧 here I come

I see what you did there @lady3janepl

@yogidevbear you've needed a log in for a long long time.

iirc you needed to login back when it was still sun hosted

@lady3janepl People? Only on person but to the Clojure community multiple names..... 🙂

oh, what are you other names @jasonbell?

@mccraigmccraig Oh you know...... here, Jade appears to be popular, I don't fight it anymore. It's more a kind form of communityacceptance.

Mornin' again 🙂 Just got the call from our data center folks to restart everything because they needed to restart the database again. Now they have Percona dev team involved. But I expect to go back to the land of nod again for at least a few hours more. Soon. 🙂

You mean to tell me that Jade isn't your real name?!

obviously Jade is his real name. Like Ged in Wizard of Earthsea. It gives us powers over him.

welcome @alex.lynham

ahoy hoy

didn't know this existed until @carr0t told me about it last night

Eyup 🙂

this channel is getting biiig

yay clojure

340 members, but only about 6 that do most of the talking 😉

more than 6 now I think

yeah on slack at work there's about 4-5 people in the engineering channel doing all the yakking

everyone else is doing real work

lol

maybe activity in this channel is correlated with unemployment (from clojure)?

everyone else is not clojuring so

running lein modules or boot-cljs is well correlated with most of #clojure-uk chat activity

I'm benchmarking json serializers but yeah

that's basically compiling right?

more or less

xkcd time!

just waiting for the banhammer to descend on my use of it

I end up chatting on here while our Jenkins server compiles Clojure and builds AMI snapshots

For some reason I don't understand, boot build on our Jenkins box running CentOS 6 is much faster than running it locally on a high spec MacBook. Probably disk I/O related

But we very rarely build anything locally

@carr0t i'm also observing that building our uberjars and docker images is much faster on AWS (m4.xlarge) than on my high-spec mbpr

bc you're running slack on yr mbpr

Yeah, our instances are m4.xlarge too

They were t2.medium, which in our experience runs similarly to m4.xlarge as long as you're not network constrained and don't run out of CPU credits

But we ran out of CPU credits

Totally going to blow my own horn here, https://github.com/juxt/pack.alpha is really fast at building uberjars in my tests so far. As a function of it's process.

it is my job to hang out here and make sure that you lovely people are doing enough work 👻

real work that is!

😉

I've totally got distracted by a foray into Esperanto affixes.

...I'm still benchmarking...

first test of this new jsonista library and it absolutely s data.json (obv) and nippy

"Aiming to be faster than cheshire"

Interesting, that's what we're using 🙂

so this seems to suck - in one context, i need to write 32 bit java.lang.Integers to EDN and have them read back as 32 bit java.lang.Integers... but pr then edn/read converts everything to java.lang.Long by default. afaict my only recourse is to (defmethod print-method java.lang.Integer [x writer] ...) and write a custom tag for java.lang.Integers - but that leaves me with a custom tag in all the contexts where i don't care about the particular integer type

is there any way of printing EDN without going through pr and friends ?

Java still doing stuff with Ints and Clojure using Longs for nearly everything has bitten us with interop too

I had that the other day!

it's not unreasonable in this case - the Int is mapped to an underlying 32 bit int field in a database

@mccraigmccraig what about Transit?

I was trying to work out why this data run was slowing down, looks like I've filled my hard drive with fake data

hmm. i could use transit in this case @sundarj if it maintains Ints through encode/decode

i think it doesn't by default, but Transit is extensible right

you could add a custom reader/writer for ints

looks like it might be workable @sundarj http://cognitect.github.io/transit-clj/#cognitect.transit/writer

isn't EDN suppose to be Extensible as well?

@thomas it is, but the write extensibility is global, through pr extensions

yeah, but the unit of extensibility in EDN is reader tags

there's a proposal to let EDN writers be more sensibly extended https://dev.clojure.org/pages/viewpage.action?pageId=8192126 but it's quite old and hasn't happened

ok.... so not quite as extensible as intended maybe.

and I think transit has superseded EDN at cognitect.

really? that's interesting

Given they wrote it, is it that surprising? 😉

true I guess, but that's also true of EDN

& EDN had lofty aspirations

I could have sworn it was possible to have non-global extensions in EDN

<goes code hunting…>

probably good for me to use transit anyway here @peterwestmacott ... it's for a db dump/restore tool which is encoding/decoding lots of records

looking at it, it might just have been edn/read-string that lets you pass custom readers

but not at write-time

I’m not seriously suggesting this, but there is always defmethod/`remove-method`

managed to get an Integer round-trip with transit working in my repl, so it does work 😛

I thought the reason of moving to transit from EDN was that EDN didn't quite deliver what was expected of it and that it was on the slow side. transit would be faster because of all the hand optimised JSON parsers. that was the thinking at least AFAIK.

huh, transit throws an exception to indicate EOF and it's not even a distinguished exception, but a RuntimeException

that's way ugly

o.0

eyetwitch intensifies

…I guess it’s still in progress?

despite that - transit seems to be working nicely - thanks for the idea @sundarj 😄