Can these be silenced?

Downloading: io/grpc/grpc-core/maven-metadata.xml from central
Downloading: io/grpc/grpc-api/maven-metadata.xml from central
Downloading: org/clojure/clojure/maven-metadata.xml from clojars
Downloading: io/grpc/grpc-netty-shaded/maven-metadata.xml from central
Downloading: org/clojure/clojure/maven-metadata.xml from central

@vemv That indicates something is using either a version range or a symbolic version (LATEST or RELEASE).

TIL, thanks! makes sense. we're not even using the one dep that is specified at RELEASE so yeah... will zap it ⚡

Sometimes running "clj" downloads a large amount of dependencies. There is a progress report, but per download only. But if any single download is very large, we do not see any progress, and clj seems to hang. "mvn install" does this better, it has a per file donload progress. Maybe this it could be added to "clj" ? Sometimes I do a "clj -Spom; mvn install" just to avoid this apparent hanging

We have a ticket for this, can’t say it’s very high on my priority list

Are there any known issues with tools.deps and :mvn/repos where tools deps won’t fetch artifacts from a 3rd party repo when you have 2 private s3 repos for your corp (in ~/.clojure/deps.edn ) and then add an extra 3rd party repo for a supplier in a specific projects deps.edn?

Basically we’re finding that we can’t resolve a bunch of deps that one of our suppliers is hosting on their own maven repo when we include our s3 repos too

Is this the s3 concurrency thing again?

I was wondering that actually

I’ll try setting -Sthreads 1

how are you providing creds? ambient AWS or via repo settings?

doesn't sound like a concurrency thing, sounds like an access thing

For the s3 repos I think it’s done via settings.xml — for the supplier repo — there are no creds (it’s all public)

the s3 repos are our in-house stuff, and they work in other projects etc fine — it’s only the project which adds a new supplier repo in the project deps.edn that struggles. It also gets our deps fine; it’s the suppliers deps it doesn’t resolve.

but if I remove our s3 repos from ~/.clojure/deps.edn and remove the deps we need from there from the project; so just the suppliers :mvn/repos are active in the projects deps.edn with their dependencies it works.

@rickmoynihan you can use -Srepro for this

ahh I think I see what @alexmiller is saying — that perhaps the s3 creds are providing creds for the 3rd party repo!? Which it’s then refusing?!

A colleague has also managed to recreate the same findings (after blowing away her .m2)

-Sthreads 1 seems to be helping… it looks like it has got further anyway (just taking a long time to fetch)

ok -Sthreads 1 seems to have actually worked — though it took forever

I’m not sure if the supplier have some dodgy deps either — as literally 1/2 of maven central came down… more than I’d normally expect… e.g. even apache ant! 😕

at one point I thought it might have been fetching the same deps in a loop -- though could have been deps with similar names

checking -Stree output now to see if anything odd is going on

hmm ok I guess it’s legit though does seem a bit odd:

com.cemerick/url 0.1.1
  . pathetic/pathetic 0.5.0
    . com.cemerick/clojurescript.test 0.0.4
      . org.clojure/clojurescript 0.0-1586
        . com.google.javascript/closure-compiler r2180
          . args4j/args4j 2.0.16
          X com.google.guava/guava 13.0.1 :older-version
          X com.google.protobuf/protobuf-java 2.4.1 :superseded
          . org.json/json 20090211
          . org.apache.ant/ant 1.8.2
            . org.apache.ant/ant-launcher 1.8.2
          X com.google.code.findbugs/jsr305 1.3.9 :older-version
          . com.googlecode.jarjar/jarjar 1.1
        . org.clojure/google-closure-library 0.0-2029-2
          . org.clojure/google-closure-library-third-party 0.0-2029-2
        . org.mozilla/rhino 1.7R4

Hello I'm having this error and I can't understand why Error building classpath. Could not find artifact com.datomic:ion:jar:0.9.50 in central () This error says that i can't find com.datomic/ion, but it exists in my fs

ls ~/.m2/repository/com/datomic/ion/0.9.50/ 
ion-0.9.50.jar  ion-0.9.50.jar.sha1  ion-0.9.50.pom  ion-0.9.50.pom.sha1  _remote.repositories

clj -Strace do not write trade.edn

clj -Srepro -Sforce -Sdeps '{}' -Strace do the same error as clj -Spath (in the same directory that contains my deps.edn) clj -Strace in a empty dir works

Do you have ambient aws creds with s3 read?

i can do aws s3 ls and it list my S3 buckets

there is something that I can do to get more debug info? why trace do not work? why -Sforce -Srepro -Sdeps {} do not work?

why are you doing -Sdeps {} ?

-Sdeps do not "overwrite" deps.edn?

no, merge

oh. ok. And about trace? Why it not work? Why/which package is requiring datomic/ion? (that is a huge project, with a lot of local/root) Why it is trying to find datomic/ion if it exists on disk?

trace is written at the end, so wouldn't work if you are erroring out

not sure I can answer why/which is requiring datomic/ion - presumably something that uses datomic

it might be looking for a different version of datomic/ion than you have

is this a deps.edn you can share?

nope 😕 It contians many local/root and git deps.

I guess it looks like the same version above

I would certainly try re-running your original command with -Sforce (no -Sdeps)

other than that, not sure what to suggest other than selectively bisecting your deps to get to something shareable/traceable

Reproduced with a "inline" deps https://gist.github.com/souenzzo/6f2143b9247a06a8527422a6ecc50990

that doesn't look like the right maven repo

should be "datomic-cloud" {:url ""} I think?

clj -Sdeps '{:deps {com.datomic/ion {:mvn/version "0.9.50"}} :mvn/repos {"datomic-cloud" {:url ""}}}

does that work?

worked!

as to why it's downloading when it exists, I'm honestly not sure about that one

my suspicion is that some of the update checker stuff in maven relies on metadata files the s3 repo does not provide and it's redoing something it shouldn't

certainly that would make sense to me for SNAPSHOT or RELEASE versions, but in this case it's neither so that seems weird (unless you did have that somewhere)

are there templates for tools.deps like there are for leinigen? wondering if there is a way to bootstrap a pedestal project faster