This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2018-08-13
Channels
- # aleph (6)
- # architecture (29)
- # beginners (175)
- # cider (22)
- # clara (5)
- # cljdoc (5)
- # cljs-dev (28)
- # cljsrn (6)
- # clojure (62)
- # clojure-finland (7)
- # clojure-italy (7)
- # clojure-nl (2)
- # clojure-spec (23)
- # clojure-uk (194)
- # clojurescript (90)
- # core-async (2)
- # cursive (23)
- # datomic (41)
- # defnpodcast (2)
- # editors (4)
- # emacs (1)
- # figwheel-main (41)
- # fulcro (53)
- # hoplon (15)
- # hyperfiddle (4)
- # immutant (1)
- # jobs (7)
- # jobs-discuss (103)
- # lein-figwheel (9)
- # off-topic (34)
- # onyx (3)
- # parinfer (1)
- # portkey (1)
- # re-frame (7)
- # reagent (2)
- # remote-jobs (2)
- # rum (1)
- # shadow-cljs (148)
- # sql (54)
- # tools-deps (3)
- # vim (7)
I was asked to try to compare salaries for Big Data engineers in London knowing Python/Scala and Clojure. The hypothesis is that in Big Data space Python and Scala are standard therefore most people would know at least one of them and requiring Clojure on top would make them more expensive. Any ideas how people would approach such problem? So far my meagre list of ideas: 1) asking friends 2) looking at advertised jobs on job boards 3) https://www.itjobswatch.co.uk/ 4) asking here! I don’t think there is a good answer, but if anyone has any I would be grateful!
Note, Python would be 'standard', but Scala? Nah - probably C++ before Scala...
Scala not standard in the Spark-land? I would assume so - the Scala APIs seem better
I’m not an expert in the ecosystem though
PySpark: serious performance hurdles from the design
there was also a screenshot from authors of High Performance Spark: Holdens and Rachel attached
no storage space in the slack though 😕
Oh, if you're talking about typical 'map/reduce' (hadoop etc) stuff, I suppose Scala be there - but then Python not so much. More likely Java is more used than both of them put together in that space. I thought you were talking more ML stuff. There Python would be the bigger player at this point. Scala more or less non existent - maybe even less than Clojure
I'm hoping (and cautiously optimistic) that Clojure will become a real player in the ML space. There are many technical advantages, but we haven't yet reached 'lib breakeven'
I’m fairly new in the ‘Big Data’ area and have no experience in the ML/AI world … In big data Spark seems the most popular solution and this is what I’ve been looking so far. (Plus Apache Beam) Spark MLib is not a good option?
that discussion is now pretty far off from #job-discuss 😂
RIght - no longer job-discuss related as such. However, I would also strongly recommend looking at #onyx as an alternative to Spark. It's way better thought out.
Python most common, scala less surprising in terms of the API
In terms of hiring we've found there's v few data engineers full stop so often backstopping with freelancers is the only way to go - body shops obv being super expensive
(to answer your q on the main thread)
Permies you've gotta offer a decent chunk of the freelance rate they'd get so like maybe 80k+ for experience, idk based on the fact we see even outside of London 6-800 as a day rate
TBH, Clojure or another FP language and willingness to learn + some Big Data experience - ideally Spark
the sample size you’re going to get matching the requirements will be tiny and have a huge variability in experience
yup, exactly!
I guess this is more general question then Big Data, Clojure and London
How do employers decide on salary bands given really limited information of the general market?
How do hiring managers within the company negotiate the renumeration for specialist positions?
Apparently this is useful: https://www.payscale.com/
But I would also be interested in knowing how others figure out what salaries are “standard” and “fair”!
from employee perspective or employer perspective?
I for one don’t think that such difference between software engineers and everyone else exists
Personally I usually negotiate as high as I can get away and then some more
When working the salary knowledge would spread in one way or another
and sometimes that means others would ask for higher salaries
One way that my startup determined salaries to offer was based on information provided by VC networks. A few VCs have private networks for their portfolio companies that maintains things like comp data and they have a recruiting team and you can ask questions to other members of the network Quora-style. Usually the comp data is broken down into equity and salary and stage of the company. Obviously people negotiate and positions dont always neatly fit into the data but it was at least a starting point.
i think in a negotiation it's probably worse for a company to low-ball than for a potential employee to high-ball. If you low-ball someone by too much they'll be offended and then your negotiation is off to a bad start or they'll just walk away. I have a hard time imagining a company, once you've gone through the interview process and the team likes you, getting too mad at you for asking for more than they're willing to pay. The exception might be for very large companies that have a lot of interest from devs to work there.
Yeah, worst they can say is that they're not willing to go that high. Then you have to decide if you want to go low enough to meet their offer or not
here’s a decent article on salary negotiation: https://www.kalzumeus.com/2012/01/23/salary-negotiation/
Incidentally, they linked this article over on #jobs https://circleci.com/blog/how-we-interview-engineers-at-circleci/
Out of any group of 1000 applicants: 250 will pass the initial screen. 117 will pass the hiring manager phone screen. 44 will pass the micro-skills assessment portion of the interview. 7 will pass the macro-skills assessment. Fewer than 3 will pass the on-site interview and receive offers.
Those numbers don't seem to jibe with what they write at the bottom of the article, > For example, right now with an average .5% conversion rate for applicants, we’d need to look at up to 4,000 candidates to hire another 20 engineers. so they're hiring more like 5 per 1000 than "fewer than 3", if it was 1 or 2 they would need to look at more like 10-20k candidates for 20.
It's easy to get "applicants"
i mean they can probably just throw the vast majority of the applications in the trash because they're probably not even applying for the right job, or forgot their resume, or are people trying to reach customer support through the job application site (seriously)
"hiring manager phone screen" -> hires of 1% is too low. That's a waste of an actual hiring managers time
the start number and the final number might be right (0.5) but I think the numbers in the middle are probably not what they're saying there
what's attracting so many developers to work at circleci. Compensation or coolness factor?
Gotta be compensation. CI cool??? Too harsh - necessary but 'cool' not something that comes to mind
im not sure what their compensation is like...but they seem to offer remote work, they're clojure-based, and the software is pretty nice
I remember reading discussions where hiring managers would talk about how a lot of candidates can’t code fizz buzz
You'd be surprised...
Yep +1 we do this one early now
they hire remotely worldwide AFAIK
but they are still able to get jobs, they just work for SME's doing boring stuff in C# or Java. Nothing wrong with that.
a lot of organisations that kill your soul …
so one time this company had me do an online interview screen and they asked me to do FizzBuzz. The nice thing was that you could pick a language to do it in, so I chose C and did fizzbuzz using bitwise operations and no if / case /ternary statements. I never even got a call back! Come on...
well thanks for that 😛 now i know for sure I'm a shitty dev right now
Oh, no one can compare themselves to aphyr. He is a unique superhero, changed the distributed systems world.
check out the next two as well, it’s amazing if you like smartassery for fun and profit
Job interview process is a piece of information about the company in itself
if you pass you’ll join the team that was selected based on that process and even likely designed it
or had input into designing it
and got a bunch of canned emails from devops contractors, probably scraping the comments for email addresses
@jgh I guess it depends what they're looking for. Here we value code clarity and 'easy of understanding' for someone new coming onto a project. Especially when working in less common languages like Clojure over, say Java or JavaScript. So as long as there is no significant and relevant performance gain, writing something by being 'clever' using bitwise operators instead of the normal/simple case would actually count against you
Maybe unless you provided a readme that said "I did this because it demonstrated an X% performance increase over if/case statements as tested using Y"
https://www.reddit.com/r/cscareerquestions/comments/95dgrx/i_am_absolutely_mortified_and_embarrassed_beyond/ tl;tr Guy killed owner dog during interview, by accident.
Regarding the conversation in #jobs about Toptal I worked with a client who hired a very talented Clojure(Script) dev from Toptal. At least one person has gotten Clojure work off of their site.
now do you take that job if you get a call back? That would be a really awkward position to be in. Thankfully it doesnt appear to be their fault, at least from how they tell the story.
I probably wouldn’t unless if it’s my dream job. Even if it’s no one’s fault, it’s just going to be a cloud over your head
Unless they hated the dog
Gotta be compensation. CI cool??? Too harsh - necessary but 'cool' not something that comes to mind
@jsa-aerial once you’re forced to use jenkins for a while then Circle CI is very cool
I'm the Technical Recuiter at CircleCI. Feel free to DM me with any questions