This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2018-03-15
Channels
- # aatree (1)
- # atlanta-clojurians (3)
- # beginners (112)
- # boot (4)
- # boot-dev (1)
- # bristol-clojurians (1)
- # cider (55)
- # cljs-dev (23)
- # cljsjs (1)
- # cljsrn (7)
- # clojars (24)
- # clojure (84)
- # clojure-brasil (1)
- # clojure-china (1)
- # clojure-italy (27)
- # clojure-norway (17)
- # clojure-romania (1)
- # clojure-spec (109)
- # clojure-uk (92)
- # clojurescript (94)
- # community-development (1)
- # core-matrix (1)
- # cursive (12)
- # datascript (1)
- # datomic (23)
- # figwheel (1)
- # fulcro (17)
- # hoplon (11)
- # jobs-discuss (3)
- # keechma (6)
- # lein-figwheel (4)
- # leiningen (79)
- # lumo (32)
- # mount (42)
- # off-topic (22)
- # onyx (13)
- # parinfer (30)
- # portkey (47)
- # powderkeg (1)
- # programming-beginners (24)
- # protorepl (3)
- # re-frame (16)
- # reagent (100)
- # ring-swagger (7)
- # shadow-cljs (134)
- # spacemacs (3)
- # sql (1)
- # tools-deps (48)
- # uncomplicate (1)
- # unrepl (14)
- # yada (1)
Is there a database of list of dependencies for a given artifact. I can't access it from the API. I wish to build a website that prints the dependency tree of a given library for the given version and also to track the issue with latest JDK. Is this data available via API or as a JSON dump or do I need to crawl the data?
@xtreak29 Dependencies are part of maven data: http://repo.clojars.org/metosin/eines/0.0.9/eines-0.0.9.pom look for <dependencies>
Thanks. Is POM available as a JSON or much helpful as a dump? That would help me avoid scraping
Sorry. I clicked the link and rendered them in a browser. The XML output is helpful. Still a database will be very much helpful or I need to download the entire POM and construct a database for myself. I am sure someone would have done this already.
As far as I remember, Clojars doesn't have the dependency information in DB
Thanks. It gave me a good pointer. It's just that I don't want to scrap and load the server if the data is available since there are around 153k entries as I can get from http://clojars.org/repo/all-poms.txt.gz.
Hmm I think there is a way to load all pom files, for development environment
Or maybe I have just used rsync. You could probably tell rsync to only load pom files, not jars.
> If you want to use the actual repo from http://clojars.org, you can grab it via rsync.
> Note that this setup task isn't perfect - SNAPSHOTS won't have version-specific metadata (which won't matter for the operation of clojars, but may matter if you try to use the resulting repo as a real repo), and versions will be listed out of order on the project pages, but it should be good enough to test with. https://github.com/clojars/clojars-web
I am ok with non snapshot data but there is no information about the URL for rsync and so on.
Hmm? Wiki shows the rsync command
Yes, got it thanks : https://github.com/clojars/clojars-web/wiki/Data#rsync-the-whole-repository
--exclude '*.jar'
might work, or --exclude '*' --include '*.pom'
I tried rsync -av --delete
. It creates the folders. Around 42MB of empty folders but the pom files are printed on the screen and not downloaded. I cancelled in the middle. Am I missing something? I am trying to use the command against less data
maybe change the include - exclude order, so that include is done after exclude
Gets me an empty directory
ā ~ rsync -av --delete my-wonderful-copy-of-clojars --exclude="*" --include="*/" --include="*.pom"
receiving incremental file list
./
sent 53 bytes received 55 bytes 30.86 bytes/sec
total size is 0 speedup is 0.00
rsync -av --delete
works . It seems there are duplicate pom files that I need to clean up. Thanks a lot.
@xtreak29 there is also https://github.com/clojars/clojars-web/wiki/Data which might have what you need, if not then open an issue and we might be able to add it