Fork me on GitHub
#jobs-discuss
<
2018-08-13
>
dm308:08:12

depends on how involved in the domain you’re going to be

dm308:08:19

also as a tech person you’ll usually be expected to learn the domain stuff on the job

3Jane08:08:18

I’d be careful with that if you don’t want to end up as a product manager for example

Aleksander09:08:40

I was asked to try to compare salaries for Big Data engineers in London knowing Python/Scala and Clojure. The hypothesis is that in Big Data space Python and Scala are standard therefore most people would know at least one of them and requiring Clojure on top would make them more expensive. Any ideas how people would approach such problem? So far my meagre list of ideas: 1) asking friends 2) looking at advertised jobs on job boards 3) https://www.itjobswatch.co.uk/ 4) asking here! I don’t think there is a good answer, but if anyone has any I would be grateful!

Sam H09:08:06

Create an anonymous poll / form and post in #clojure-uk 😉

jsa-aerial14:08:37

Note, Python would be 'standard', but Scala? Nah - probably C++ before Scala...

Aleksander14:08:20

Scala not standard in the Spark-land? I would assume so - the Scala APIs seem better

Aleksander14:08:33

I’m not an expert in the ecosystem though

Aleksander15:08:21

PySpark: serious performance hurdles from the design

Aleksander15:08:25

there was also a screenshot from authors of High Performance Spark: Holdens and Rachel attached

Aleksander15:08:38

no storage space in the slack though 😕

jsa-aerial17:08:15

Oh, if you're talking about typical 'map/reduce' (hadoop etc) stuff, I suppose Scala be there - but then Python not so much. More likely Java is more used than both of them put together in that space. I thought you were talking more ML stuff. There Python would be the bigger player at this point. Scala more or less non existent - maybe even less than Clojure

jsa-aerial17:08:40

I'm hoping (and cautiously optimistic) that Clojure will become a real player in the ML space. There are many technical advantages, but we haven't yet reached 'lib breakeven'

Aleksander21:08:51

I’m fairly new in the ‘Big Data’ area and have no experience in the ML/AI world … In big data Spark seems the most popular solution and this is what I’ve been looking so far. (Plus Apache Beam) Spark MLib is not a good option?

Aleksander21:08:21

that discussion is now pretty far off from #job-discuss 😂

jsa-aerial22:08:02

RIght - no longer job-discuss related as such. However, I would also strongly recommend looking at #onyx as an alternative to Spark. It's way better thought out.

alexlynham09:08:25

Python most common, scala less surprising in terms of the API

alexlynham09:08:27

In terms of hiring we've found there's v few data engineers full stop so often backstopping with freelancers is the only way to go - body shops obv being super expensive

alexlynham09:08:41

(to answer your q on the main thread)

alexlynham09:08:31

Permies you've gotta offer a decent chunk of the freelance rate they'd get so like maybe 80k+ for experience, idk based on the fact we see even outside of London 6-800 as a day rate

Sam H09:08:26

What actual skill set do you look for / test for for Big Data engineers?

Aleksander10:08:09

TBH, Clojure or another FP language and willingness to learn + some Big Data experience - ideally Spark

👍 4
Sam H10:08:47

what lib do you use in clojure for interfacing with spark?

dm309:08:29

the sample size you’re going to get matching the requirements will be tiny and have a huge variability in experience

Aleksander09:08:22

yup, exactly!

Aleksander09:08:46

I guess this is more general question then Big Data, Clojure and London

Aleksander09:08:21

How do employers decide on salary bands given really limited information of the general market?

Aleksander09:08:26

How do hiring managers within the company negotiate the renumeration for specialist positions?

3Jane09:08:01

Apparently this is useful: https://www.payscale.com/

3Jane09:08:22

But I would also be interested in knowing how others figure out what salaries are “standard” and “fair”!

Aleksander09:08:37

from employee perspective or employer perspective?

Aleksander09:08:53

I for one don’t think that such difference between software engineers and everyone else exists

3Jane09:08:34

Both perspectives are useful

3Jane09:08:02

Whichever side you’re on, it helps to understand the other one

Aleksander12:08:26

Personally I usually negotiate as high as I can get away and then some more

Aleksander12:08:01

When working the salary knowledge would spread in one way or another

Aleksander12:08:24

and sometimes that means others would ask for higher salaries

jgh12:08:19

One way that my startup determined salaries to offer was based on information provided by VC networks. A few VCs have private networks for their portfolio companies that maintains things like comp data and they have a recruiting team and you can ask questions to other members of the network Quora-style. Usually the comp data is broken down into equity and salary and stage of the company. Obviously people negotiate and positions dont always neatly fit into the data but it was at least a starting point.

jgh13:08:24

i think in a negotiation it's probably worse for a company to low-ball than for a potential employee to high-ball. If you low-ball someone by too much they'll be offended and then your negotiation is off to a bad start or they'll just walk away. I have a hard time imagining a company, once you've gone through the interview process and the team likes you, getting too mad at you for asking for more than they're willing to pay. The exception might be for very large companies that have a lot of interest from devs to work there.

👍 4
danm13:08:40

Yeah, worst they can say is that they're not willing to go that high. Then you have to decide if you want to go low enough to meet their offer or not

Sam H13:08:14

here’s a decent article on salary negotiation: https://www.kalzumeus.com/2012/01/23/salary-negotiation/

3Jane14:08:33

Incidentally, they linked this article over on #jobs https://circleci.com/blog/how-we-interview-engineers-at-circleci/

3Jane14:08:41

It blows my mind.

3Jane14:08:53

Out of any group of 1000 applicants: 250 will pass the initial screen. 117 will pass the hiring manager phone screen. 44 will pass the micro-skills assessment portion of the interview. 7 will pass the macro-skills assessment. Fewer than 3 will pass the on-site interview and receive offers.

jgh15:08:12

Those numbers don't seem to jibe with what they write at the bottom of the article, > For example, right now with an average .5% conversion rate for applicants, we’d need to look at up to 4,000 candidates to hire another 20 engineers. so they're hiring more like 5 per 1000 than "fewer than 3", if it was 1 or 2 they would need to look at more like 10-20k candidates for 20.

3Jane15:08:12

5 per 1000 is still a damn small number

jgh15:08:18

even then i wonder if they're not exaggerating a little.

jonahbenton15:08:12

It's easy to get "applicants"

jgh15:08:49

i mean they can probably just throw the vast majority of the applications in the trash because they're probably not even applying for the right job, or forgot their resume, or are people trying to reach customer support through the job application site (seriously)

jonahbenton15:08:23

"hiring manager phone screen" -> hires of 1% is too low. That's a waste of an actual hiring managers time

jgh15:08:30

the start number and the final number might be right (0.5) but I think the numbers in the middle are probably not what they're saying there

hlolli15:08:24

what's attracting so many developers to work at circleci. Compensation or coolness factor?

jsa-aerial17:08:17

Gotta be compensation. CI cool??? Too harsh - necessary but 'cool' not something that comes to mind

3Jane15:08:57

How representative is that for a hiring process anyway?

jgh15:08:50

im not sure what their compensation is like...but they seem to offer remote work, they're clojure-based, and the software is pretty nice

3Jane15:08:57

I remember reading discussions where hiring managers would talk about how a lot of candidates can’t code fizz buzz

3Jane15:08:03

but I’ve always assumed this was for entry roles

jsa-aerial17:08:20

You'd be surprised...

alexlynham09:08:25

Yep +1 we do this one early now

joelsanchez15:08:10

where did 1000 clojure applicants come from? Mars?

😂 20
jgh15:08:26

haha that's probably why they can eliminate so many of them

Aleksander15:08:47

they hire remotely worldwide AFAIK

jgh15:08:08

yeah there are definitely a lot of people out there who can't code worth a damn

jgh15:08:24

but they are still able to get jobs, they just work for SME's doing boring stuff in C# or Java. Nothing wrong with that.

Aleksander15:08:40

a lot of organisations that kill your soul …

Aleksander15:08:03

I keep being surprised how bad software organisations are

☝️ 8
jgh15:08:47

so one time this company had me do an online interview screen and they asked me to do FizzBuzz. The nice thing was that you could pick a language to do it in, so I chose C and did fizzbuzz using bitwise operations and no if / case /ternary statements. I never even got a call back! Come on...

jgh15:08:28

sorry, i lied, it did use a case statement

Fahd El Mazouni16:08:24

well thanks for that 😛 now i know for sure I'm a shitty dev right now

3Jane16:08:39

Clojure lends itself to funny code 🙂 look up swearjure

jonahbenton16:08:14

Oh, no one can compare themselves to aphyr. He is a unique superhero, changed the distributed systems world.

jgh15:08:37

i guess they didnt feel like hiring smartasses

jgh15:08:20

this article is pretty good haha

3Jane15:08:56

check out the next two as well, it’s amazing if you like smartassery for fun and profit

Aleksander15:08:48

Job interview process is a piece of information about the company in itself

Aleksander15:08:18

if you pass you’ll join the team that was selected based on that process and even likely designed it

Aleksander15:08:26

or had input into designing it

scriptor15:08:04

there’s definitely always a number of irrelevant applicants

scriptor15:08:22

I once posted on a Who’s Hiring thread on HN for a backend clojure position

scriptor15:08:55

and got a bunch of canned emails from devops contractors, probably scraping the comments for email addresses

danm16:08:12

@jgh I guess it depends what they're looking for. Here we value code clarity and 'easy of understanding' for someone new coming onto a project. Especially when working in less common languages like Clojure over, say Java or JavaScript. So as long as there is no significant and relevant performance gain, writing something by being 'clever' using bitwise operators instead of the normal/simple case would actually count against you

danm16:08:08

Maybe unless you provided a readme that said "I did this because it demonstrated an X% performance increase over if/case statements as tested using Y"

jgh16:08:38

yeah i know, let's just say i wasn't too broken up about not getting a call back 😉

the2bears16:08:01

Wow... that's bad luck. What an awful story for all involved 😞

hubert16:08:38

Yup, exactly. Everyone suffers

hubert16:08:03

I love dogs and I can not even imagine ...

danielglauser16:08:15

Regarding the conversation in #jobs about Toptal I worked with a client who hired a very talented Clojure(Script) dev from Toptal. At least one person has gotten Clojure work off of their site.

👍 4
jgh16:08:14

now do you take that job if you get a call back? That would be a really awkward position to be in. Thankfully it doesnt appear to be their fault, at least from how they tell the story.

scriptor16:08:24

I probably wouldn’t unless if it’s my dream job. Even if it’s no one’s fault, it’s just going to be a cloud over your head

scriptor16:08:35

and you never know how people might be subconsciously biased

scriptor16:08:49

much better to go somewhere where you start with a mostly clean slate

rmprescott17:08:11

Unless they hated the dog

jsa-aerial17:08:17

Gotta be compensation. CI cool??? Too harsh - necessary but 'cool' not something that comes to mind

Aleksander20:08:11

@jsa-aerial once you’re forced to use jenkins for a while then Circle CI is very cool

☝️ 12
12
8
💯 12
😆 8
Brian Marigmen22:08:27

I'm the Technical Recuiter at CircleCI. Feel free to DM me with any questions