morning

morning

morning

aarrgghhh I can't start my repl anymore with out getting an error... and I have no idea what caused this. last week it worked fine 😡

I deleted my .m2 repo, but the problem won't go away

your project has some duplicate dependencies in it? perhaps the ordering of the jars has changed and your getting a different version first

have you run lein deps since clearing .m2?

(morning btw)

I did a lein repl and that downloaded a lot of jars...

hmmm I did add cucumber the other week... and might not have restarted the repl since... let me have a look

thanks guys

when doing a lein deps :tree I get the advice to loads of exclusions... is it adviced to do all of them? or just trial and error till you find something that works?

depends how much time you have 🙂

morning

@thomas I will add that lein can be a bit heavy handed with recommendations. Many of these things go in global exclusions, but lein will tell you to add them to every dependency.

But generally you should, yes.

☯️

morning

ok... I'll give it a try... thank you

morning

the other way to silence exclusions is to explicitly add the transitive dep at the top level

iirc

morning

this is a rather painful process... 😣

Morning

glenjamin: +1 I find this approach describes the intent of the override/exclusion a lot better as it at least explicitly lets you pick and document the version that resolves the conflict.

@thomas i generally set :pedantic? :abort in my lein projects - it forces you to add all the exclusions required so that there is no more than one version of any given dependency in the tree

well... when I do lein deps :tree I don't get any errors about more exclusions needed... but somehow it still getting errors somehow.

I blame it on Rich Hickey... if I hadn't watched his talk last night about this problem I wouldn't even have known about this 😇

@thomas since you are getting NoClassDefFoundError you might have gone a bit far with your :exclusions

that would be my guess too. Or you excluded the wrong thing (conflict resolution suggestions aren't always correct)

i mostly find suggestions are exactly wrong... given two choices for an exclusion the suggestion is mostly the one i don't take

ok thanks

Morning

I have a linux (specifically Ubuntu 16.04LTS) question and I know this is not a Linux channel but anyone mind if I ask?

go aheah @agile_geek

I don't think we've been very good to sticking to our even vague topic

and the topic says "randomly chat"

So hands up who has run ElasticSearch on Ubuntu?

no

So I get a warning from ElasticSearch when I start it that the number of file descriptors is 4096 and needs to be 65536

I followed at least 6 or 7 posts on how to up the number of file descriptors such that ulimit -Hn returns 65536

Including: http://ithubinfo.blogspot.co.uk/2013/07/how-to-increase-ulimit-open-file-and.html

and http://stackoverflow.com/questions/21515463/how-to-increase-maximum-file-open-limit-ulimit-in-ubuntu

All say pretty much the same

set:

*              soft    nofile         65536
*              hard    nofile         65536

make sure the entry session required pam_limits.so is set in /etc/pam.d/common-session

and log out and in

I've tried every combination of this, rebooted at least 10 times today and tried that pam_limits setting in multiple files in /etc/pam.d

However when I open a terminal and enter ulimit -Hn I get 4096 but if I then su - chris (my user) and try the ulimit cmd again I get the correct 65536

so I have a work around but I keep forgetting to su in as me before starting elastic search

it's frustrating and just wondered if anyone else had run Elastic Search on Ubuntu?

Are you using systemd?

https://ma.ttias.be/increase-open-files-limit-in-mariadb-on-centos-7-with-systemd/ this may have some pointers if so.

Systemd is it's own pita grumble grumble systemd sucks grumble grumble

I have no idea!

I am just running the elasticsearch script from it's bin lib

but the issue with ulimit -Hn is when I open a terminal

what's your ubuntu version @agile_geek ?

our production runs on ubuntu, but it's still on 14.04 lts

16.10

that's after the switch to systemd @agile_geek - best follow @dominicm's link

Cheers

I wonder how limits work if ssh is a managed resource under systemd?

Post ClojureX I realised I’m missing too much information with all the updates going on, so I’ve tried to curate things a little with a weekly update to myself. The Clojure Review https://www.getrevue.co/profile/jasonbelldata/archive/38086 feel free to signup and share as much as you want.

Morning

@jasonbell done. thank you for this!

np

@jasonbell nice work Jase! I think I would have added this too: https://www.youtube.com/watch?v=oyLBGkS5ICk&list=PLZdCLR02grLofiMKo0bCeLHZC0_2rpqsz but there's just too much to reference when you have two awesome Clojure conferences on at the same time!

I have had a lot of really good feedback about ClojureX talks from attendees of Conj who found them on SkillsMatter site so that's really 🆒

It’s in the next one, no panic. I was putting issue 2 together last night.

too late. Already panicking. I'm in a right froth now.

Another five days of froth it is, I will not be pressured by the huggerati.

😭

Wussy crying won’t help it along either.

macho crying @jasonbell ?

Que es mas macho? Pineapple o 😭

@mccraigmccraig you can if you wish but only if it’s on Soundcloud 🙂

https://soundcloud.com/bruce-durling/que-es-mas-macho-pineapple-o

there you go jasebell

There’s always one isn’t there.

usually me

And it’s usually

lol

sorry

:hugging_face:

or should it be

:hugging_face: :hugging_face:

There you go.

headings are borked 😞 oh well, for next time

wow, if that is all I have to do to get something shipped. 😉

lol

use it on the others and see how it goes

mostly I hug them. mostly.

https://www.youtube.com/watch?v=B436avtEXzs

dang... this slack doesn't haev giphy integration...

and that is probably a good thing.

@agile_geek Did the systemd thing help with your problem? I'd like to know so I have more to rant about systemd 😁

@dominicm haven't had time to try. Wasted hours on it this morning. However I read the article and its about services bit my problem is simply the limit is wrong in the terminal from which I start elasticsearch from a script. Does systemd effect logins?

does the elasticsearch start script switch user?

systemd is life. systemd overrides POSIX apis for fun.

^ that was about to be my next suggestion. Check the script, look for things like changing user, shell, HUP'ing is something else to look out for.

I should pay more attention, initial login has a reduced file limit.

Everything else is fine. Got it. Elasticsearch is a red herring 🙂

It's not a script issue....If I start a terminal logged on a my user chris the file descriptors hard limit is 4096 and if I run the elasticsearch it complains it needs more file descriptors. If I start a terminal, su into my user again from the terminal the file descriptors limit is correctly set to 65536 as I specified in the /etc/security/limits.conf and if I run the elasticsearch script then it picks up the limit for my user

@agile_geek By "start a terminal" you mean gnome-terminal (is this desktop linux)

Unity but yes

If you hadn't rebooted, I'd accuse you of not having logged out. This is strange. You're definitely into "something weird is happening" territory.

I can't help but feel like something really strange is going on. Like that ulimits are only applying to virtual connections and something about ConsoleKit checking. It's hard to tell with systems like Ubuntu, because they're so big now.

/etc/security/limits.d got anything in here?

http://manpages.ubuntu.com/manpages/xenial/man5/limits.conf.5.html relevant man page

@dominicm only a casandra.conf file that has nothing to do with the problem. I did add the appropraite limits to the /etc/security/limits.conf as per that manpage

I'm declaring Ubuntu a casualty of war.

I can workaround it

If I su into my own user before starting ElasticSearch

If I was using it a lot I would script it as a service

Might just amend the elasticsearch script to set either the limits (if possible dynamically) or su into my user

Wanted to solve it permanently in case other things need more open file handles

Time for home anyway

Quick favour if any Java heads are around? Am I being stupid whilst trying to reference PrettyTime NLP using

<!-- https://mvnrepository.com/artifact/org.ocpsoft.prettytime/prettytime-nlp -->
<dependency>
    <groupId>org.ocpsoft.prettytime</groupId>
    <artifactId>prettytime-nlp</artifactId>
    <version>4.0.1.Final</version>
</dependency>

It's failing which might be related to our proxy Nexus running out of disk space

You should go to the .m2/repository and see if the artifact is actually downloaded. If there was a previous problem it can just leave a generated POM in the repository. When you try to use that dependency it won’t be resolved. What I usually do is delete the folder containing the artifact to force Maven to download again.

You can't force Maven to download release artifacts once it thinks they’re already downloaded. If it was a snapshot you could with a mvn clean compile -U which will force it to download the latest snapshots

Doesn’t seem to be available from mvnrepository

21:20 $ ll ~/.m2/repository/org/ocpsoft/prettytime/prettytime-nlp/4.0.1.Final/ total 48 drwxr-xr-x 2 bigkahuna staff 170 Dec 6 21:20 . drwxr-xr-x 3 bigkahuna staff 102 Dec 6 21:20 .. -rw-r--r-- 1 bigkahuna staff 173 Dec 6 21:20 _remote.repositories -rw-r--r-- 1 bigkahuna staff 2182 Dec 6 21:20 prettytime-nlp-4.0.1.Final.pom -rw-r--r-- 1 bigkahuna staff 40 Dec 6 21:20 prettytime-nlp-4.0.1.Final.pom.sha1

It generated POMs as expected ‘cos it can’t find the actual artifact

But 4.0.0-Final seems to be available

21:20 $ ll ~/.m2/repository/org/ocpsoft/prettytime/prettytime-nlp/4.0.0.Final/ total 5392 drwxr-xr-x 2 bigkahuna staff 374 Dec 6 21:22 . drwxr-xr-x 4 bigkahuna staff 136 Dec 6 21:22 .. -rw-r--r-- 1 bigkahuna staff 206 Dec 6 21:22 _maven.repositories -rw-r--r-- 1 bigkahuna staff 51520 Dec 6 21:22 prettytime-nlp-4.0.0.Final-javadoc.jar -rw-r--r-- 1 bigkahuna staff 40 Dec 6 21:22 prettytime-nlp-4.0.0.Final-javadoc.jar.sha1 -rw-r--r-- 1 bigkahuna staff 3922 Dec 6 21:22 prettytime-nlp-4.0.0.Final-sources.jar -rw-r--r-- 1 bigkahuna staff 40 Dec 6 21:22 prettytime-nlp-4.0.0.Final-sources.jar.sha1 -rw-r--r-- 1 bigkahuna staff 2643502 Dec 6 21:22 prettytime-nlp-4.0.0.Final.jar -rw-r--r-- 1 bigkahuna staff 40 Dec 6 21:22 prettytime-nlp-4.0.0.Final.jar.sha1 -rw-r--r-- 1 bigkahuna staff 2211 Dec 6 21:22 prettytime-nlp-4.0.0.Final.pom -rw-r--r-- 1 bigkahuna staff 40 Dec 6 21:22 prettytime-nlp-4.0.0.Final.pom.sha1

I know this stuff as I still work in the Java mines 😄