Fork me on GitHub
#clojure-uk
<
2018-03-19
>
dominicm06:03:28

Morning 🌞

dominicm06:03:15

How's it going?

seancorfield06:03:00

I'm up late because my wife's flight from the East Coast is delayed... so I have to pick her up from SFO at 2:20am 😞

seancorfield06:03:52

But it's been a fun weekend, helping folks on the Clojurians Slack, playing with Clojure stuff, listening to music I haven't heard in ages 🙂

seancorfield06:03:17

And eating curry. Jay doesn't like curry, so I only get that when she's out of town.

seancorfield06:03:49

This week I'll be working on the beginnings of a new Clojure web app to replace an old CFML app so that'll be nice.

seancorfield06:03:14

What's on your schedule for the week @dominicm ?

dominicm07:03:06

I thought you seemed to be up quite late, that's very unfortunate! Sounds like a very relaxed weekend :). I'm hoping to be close to wrapping up my reporting export by the end of the week. And I'm going to try get my head around a new client's project so I can help out. I largely want an uneventful week after a busy week behind me.

dominicm07:03:40

@seancorfield I always assumed world singles was a monolith. Do you still many services in CFML?

seancorfield07:03:11

We have three CFML apps: the main dating app, the admin internal app, and a small affiliate/partners dashboard app. We're about halfway through migrating our sites to the new Clojure REST API with a React.js/Redux front end (and Clojure apps for login, auth, billing, and the SEO Geo content for search engines).

seancorfield07:03:03

We should be all migrated in another few months and then we can shut down the big CFML app. We are starting the admin rewrite now. We'll rewrite the affiliate dashboard as well, maybe this year, maybe next.

seancorfield07:03:49

We've migrated nearly all our English-only sites to Clojure/React.js. We're working on our non-English sites now -- translations has been the delay...

seancorfield07:03:11

(since the text is different from our old CFML apps so we need a lot of stuff re-translated)

seancorfield07:03:34

Luckily, this round of migrations doesn't involve much work on the database side -- we're only migrating paid memberships to a new system (one of the new Clojure apps). Last time we did a big migration (2012) we migrated from SQL Server to an all-new schema on MySQL. That was... entertaining...

seancorfield07:03:38

We're also in the process of writing a new chat/messaging back end system (in Clojure of course).

dominicm07:03:43

Lots to consider at once 😮. How do you handle translations from a high level? I've seen a few versions, and I've liked some far more than others.

seancorfield07:03:26

For relatively short strings we have a table of locale / key-name / translation. For long-form text, we have another table that is indexed by site ID as well as locale and key-name (since each site might have different "page" text).

seancorfield07:03:21

We have an admin that uses role-based permissions to allow translators to login and see all English translations and write access to just their locale to edit/add new translations.

dominicm07:03:16

Are the keys things like "homepage-welcome-text" or are they "Hello, ${name}"?

seancorfield07:03:23

(although for initial rounds of translations, we often send out a spreadsheet of key-name, English, <insert other language> if that's what the translator wants instead)

seancorfield07:03:15

We have names like "homepage-welcome" and the en_US version might be Hello, {1}! and the code will call (i18n/get-resource "homepage-welcome" "en_US") to get the string and then (i18n/format-string the-string [(:username member)]) to format it.

seancorfield07:03:03

Although we have that integrated into Selmer so in an HTML template, we would have {% resource homepage-welcome @member.username %}

seancorfield07:03:01

We also support Arabic so we have a whole bunch of logic to add RTL formatting to everything, which is an extra level of complexity.

dominicm07:03:20

I've always found naming the keys in a consistent way to be completely impossible. Keys tend to shift meaning over time.

seancorfield07:03:10

Yeah, naming is hard. Here's a brief look at the translation admin app https://www.dropbox.com/s/srsesp87t1fd9fq/Screenshot%202018-03-19%2000.29.40.png?dl=0

dominicm07:03:16

aboutUs welcomeToHomepageName. I'm seeing an easy naming convention here 😄

seancorfield07:03:35

Luckily we have staff that can read, write, and speak most of the languages we use so we can do a lot of the translation in-house 🙂

dominicm07:03:17

I've started taking the approach of using the english string as the key. I never have to name things again, and when the English string changes, it automatically creates a void for strings to be re-translated.

yogidevbear07:03:23

Morning beautiful people

seancorfield07:03:01

For a bit of fun, here's the Arabic string that explains browser compatibility https://www.dropbox.com/s/e44kjsm05xgxmxz/Screenshot%202018-03-19%2000.33.13.png?dl=0 -- note the {1} for the actual target of the link which is passed as an argument.

seancorfield07:03:19

Note that the text box switches to RTL for text entry in Arabic!

dominicm07:03:04

That's very cool.

seancorfield07:03:11

@dominicm We track when translations are updated and we have a job that runs every night that sends a list of outdated translations to admins who have subscribed to that.

yogidevbear07:03:42

I've never thought about how HTML tags would be represented in a RTL scenario. Seems funny to see href as href instead of ferh when everything around it is RTL simple_smile

seancorfield07:03:50

And in French http://arablounge.com/?&amp;locale=fr_FR so you can see how everything swaps around.

seancorfield07:03:27

(that's the current CFML version of the platform)

seancorfield07:03:13

This is the new React.js/Redux app with Clojure REST API behind it https://soulsingles.com/

seancorfield07:03:43

And, to link it back to something UK-specific https://turkishdating.co.uk/?locale=tr_TR 🙂

dominicm07:03:38

something about mixed latin & arabic alphabets makes me chuckle.

seancorfield07:03:23

I feel very grateful that management let us bet on Clojure back in 2011 and we definitely feel we can make changes a lot faster now than with our old system -- and the resource usage seems to be much lower (and everything runs faster too).

dominicm07:03:16

Any particular reason you chose not to go down the Clojurescript route?

seancorfield07:03:03

Well, we took a run at cljs for an internal project some years back... and the tooling was very fragile and awkward (and changing very fast). It wasn't ready for prime time. So when we started to plan for the new front end and look at hiring developers to build it, we took another look and it really still wasn't ready for what we needed to do -- both in terms of the size of the system, the (updated) tooling, and mostly in terms of actually hiring developers when looking at JS vs cljs.

seancorfield07:03:12

To put it in perspective, we started the new front-end in September 2015.

seancorfield07:03:50

cljs tooling (and cljs itself) has come a long way in the last two and a half years.

dominicm08:03:21

That's about how long I've been doing clojure 😮. Can confirm, clojurescript is a lot better to work with now. Although "size" isn't something I've needed to (or tried to) tackle particularly.

seancorfield08:03:08

I can't remember when we'd tried cljs before... digging around in our BitBucket repo isn't helping me because we deleted all the cljs exploration stuff and I can't find a branch or tag that contains that particular project. Maybe it was 2013?

seancorfield08:03:51

Or maybe 2014, based on the om-sente repo I just found in my personal GitHub account... I think we used some of that as the basis for our exploration internally. We were certainly using Om and Sente at first, then rewrote it to use Reagent.

seancorfield08:03:59

There's definitely a sense at work that we might try cljs for a future SPA since our JS devs are interested in learning it (and one of them has been playing with Clojure for a while already).

seancorfield08:03:02

Maybe when we replace the affiliate/partner dashboard, we'll use cljs for the SPA on the front end. Who knows.

seancorfield08:03:09

Looks like I'll be heading out to the airport soon -- despite taking off over an hour late, the wife's flight is now scheduled to land only 30 mins late (just before 2am).

seancorfield08:03:02

"soon" = "in about 30 mins" I think 🙂

seancorfield08:03:14

@dominicm How's your clj / tools.deps stuff going? I see a few people are putting together uberjar-building things for the new CLI tools now.

dominicm08:03:42

@seancorfield depstar is interesting, because it takes a different approach to me, it's more like leiningen's uberjars. I think there's space to improve on lein's uberjars though, so I'm confident pack will is a better choice for most people. My real difficulty is figuring out what I want the API to look like.

seancorfield08:03:27

Yeah, I was curious as to the multiple options offered by pack -- capsule and jcl -- and also why you needed to specify the deps.edn file to consume?

dominicm08:03:51

@seancorfield I initially did JCL, which is a more traditional java approach to nesting jars inside jars, then realised it was GPL, so quickly found an alternative. Capsule has some neat future possibilities, it's a trampoline (like lein), so you can specify things like default JVM opts ahead of time (so you can put the memory constraints) if you choose. It also supports caplets, which let you do neat things like fetching dependencies on startup from maven. You specify the deps.edn to consume because really all pack needs is a classpath, so the deps.edn file can be anywhere on your disk. It means I don't have to worry about the dependencies of pack colliding with that of the host project. I'll probably explore the idea of automatically picking it up from cwd at some point though.

seancorfield08:03:14

Thanks for the insight and background. I haven't tried it yet, nor depstar. I'm still looking at what it would take to migrate us to the new deps.edn format at work (instead of the custom format we have)... and that's not as high on my list as several other things 🙂

seancorfield08:03:20

I like the apparent simplicity of depstar but I don't have a sense for the real world practicality of either it or pack right now.

seancorfield08:03:16

(I think it's kind of amazing that depstar is only 200 lines of Clojure)

dominicm08:03:18

depstar has to handle horrible things like file conflicts. Which pack avoids by using a classloader. It's two diverging philosophies - fiddle with classloaders, or try and merge files you find on the disk. I have a suspicion that LICENSE file dropping violates BSD-2 and APLv2, so I avoided it. @seancorfield pack had a lot of inspiration from our discussions previously, so you should find it quite suitable for you.

dominicm08:03:06

Each pack output rocks up at around ~150 loc too. I haven't got any shared code between outputs yet, so that's a good metric at this time 😮

thomas08:03:54

a not so good morning from the train.... I am stuck in Delft at the moment....

dominicm08:03:15

Obviously for not-lambda, I pull in Capsule which is a java class file of some size. So relatively I guess it's big 🙂

otfrom08:03:42

@thomas hope your commute and day improve

thomas09:03:08

@otfrom... I hope so as well, thank you.... I had to go back to the hague and I am now going by metro to rotterdam... talking about a convoluted journey.

dominicm09:03:44

How early is too early for a snack?

yogidevbear09:03:38

No, I meant 10pm the night before 😉

thomas10:03:46

made it to work... yeah finally

chrjs16:03:01

Morning all

maleghast16:03:50

Hello All 🙂

maleghast16:03:21

Does anyone in here know how I might turn an instant back into a string-representation of a date..?

maleghast16:03:29

My Google-Fu is failing me...

maleghast16:03:07

Better still if anyone has the slightest clue how to go straight from Instant to clojure.java-time/local-date

maleghast16:03:42

I may have to drop my database and re-work my insert code to use clojure.java-time for the dates, but I expect that they will still come back out as Instants (as under the hood it is a java.sql.Timestamp), in which case I am still going to have to convert them in order to do calendar-maths on them...

maleghast16:03:11

(TLDR; if I can convert the instants that come out of the database to string-based date representations, then I can create clojure.java-time/local-date representations that are good for calendar maths, of which I have a LOT, so Instant to string is the easiest route to what I need)

sundarj16:03:02

@maleghast is

=> (str (java.time.Instant/now))
"2018-03-19T16:48:04.951Z"
not what you want?

maleghast16:03:05

It might be... Let me try...

maleghast16:03:02

Perfection! Thanks @sundarj - sometimes it's the obvious thing you just haven't tried...

sundarj16:03:51

no problemo 🙂

maleghast17:03:25

Yep, I am pretty sure that nails it... Basically the API I am working with communicates dates (in JSON) as strings yyyy-MM-dd. I have to make them into Instants to safely insert them in the database, but when they come out I want to do calendar maths on them, and that requires clojure.java-time, so I needed a way to take the strings into that space do the maths and then get the new strings out for sending to the API.

maleghast17:03:30

Talk about headache!

maleghast17:03:47

Really helped me out there ^^ so thanks @sundarj

maleghast17:03:35

Of course now my app has just suddenly stopped working... 😞

maleghast17:03:30

@dominicm - Is there an obvious "answer" to a message like this from an Edge app:

java.lang.IllegalStateException: Attempting to call unbound fn: #'edge.noaa-ncdc/noaa-ncdc-stations-harvester-job

maleghast17:03:21

Ignore that @dominicm - Rainbow Parens to the rescue - I had moved an entire function inside another (defn ... ) sexp so that's what that was, but I could see visually that it was wrong, so all's well that ends well 🙂 Sorry to tag you on it, but I was wondering if it was a "known" Edge error... Just PBCaK... 😉

dominicm18:03:24

@maleghast I recommend parinfer for avoiding these bugs.

maleghast18:03:51

Parinfer? Is that an Emacs library that I can pull into my setup, or is it a Clojure thing..?

maleghast18:03:26

I already use an Emacs setup with Paredit set up, but it does not stop me from yanking and pasting in stupid ways.

maleghast18:03:09

Paredit is more powerful than what I use it for, I know that, but I just use it to have some powerful shortcuts and to make sure that whenever I open ( [ or { I get a closing one right away.

maleghast18:03:27

I will, thanks 🙂

dominicm19:03:49

There is an emacs thing btw

otfrom19:03:13

I like paredit and aggressive indent (along with rainbow-parens)

otfrom22:03:51

which looks like it does parinfer like things via other means