This page is not created by, affiliated with, or supported by Slack Technologies, Inc.
2021-07-14
Channels
- # announcements (3)
- # babashka (189)
- # beginners (157)
- # calva (5)
- # cider (5)
- # clj-kondo (7)
- # cljdoc (34)
- # clojure (61)
- # clojure-dev (2)
- # clojure-europe (42)
- # clojure-nl (15)
- # clojure-poland (1)
- # clojure-spec (5)
- # clojure-uk (6)
- # clojured (2)
- # clojurescript (31)
- # clojureverse-ops (8)
- # component (2)
- # cursive (41)
- # datomic (15)
- # depstar (44)
- # figwheel-main (9)
- # fulcro (14)
- # holy-lambda (1)
- # inf-clojure (13)
- # introduce-yourself (1)
- # jobs (1)
- # lsp (98)
- # malli (12)
- # off-topic (12)
- # pedestal (1)
- # polylith (3)
- # re-frame (51)
- # reitit (4)
- # releases (1)
- # reveal (5)
- # shadow-cljs (3)
- # tools-deps (56)
- # vim (12)
- # xtdb (36)
What can I do about it: https://cljdoc.org/builds/46616
Hey! :) have you tried rebuilding in case this is intermittent
How can I do it?
There’s a hidden button in the top right, next to the GitHub link. Unfortunately it looks like this heap space issue seems persistent, I even restarted cljdoc. Is there anything unusual about your repo? It looks like other builds work fine
Still don't know where the button is. Hmm I don't know I did pretty standard release.
So v0.2.3 failed, but v0.2.2 worked. I just hit the rebuild button on v0.2.2 and it has now failed.
Seems to be failing on the clone? I can take a look at this sometime later today if nobody else beats me to it.
It ingested fine on my dev box, but I have 32gb of RAM. @U050TNB9F If I understand cljdoc infrastructure correctly, https://github.com/cljdoc/cljdoc/blob/c12eaae2f40447bc1009af55fbe41566f6d152f3/ops/infrastructure/server_instance/instance.tf#L15?
I guess something interesting about the holy-lambda repo is that it has some larger files. I’ll restrict RAM on my test locally and see if I can trigger the same error.
Hmm maybe it looks in modules folder?
Yeah, it clones the entire repo. https://bugs.eclipse.org/bugs/show_bug.cgi?id=369066.
Might be easiest/reasonable just to bump up RAM of cljdoc server? I dunno who pays for that though. @U050TNB9F?
Or… we could switch to spawning out to a git executable instead of using jgit, and see if that helps. Clojure tools deps has switched from jgit to git executable.
@UJ1339K2B did would you be ok with creating a https://github.com/cljdoc/cljdoc/issues? Probably a better spot to record findings and options.
I'm having a babashka runtime in zip file maybe that's the cause
Sure. Submitted an issue: https://github.com/cljdoc/cljdoc/issues/458
I’m open to upgrade to a bigger box but it’s been a while I set this all up so it’ll take some time. In the meantime maybe not packaging babashka as part of your jar is also an option?
Yeah. I can move it to releases.
oh yeah sorry, meant the repo
@U050TNB9F @UE21H2HHD Just took a second look. I have only one file which weights like 80mb. I think that cljdoc should not fetch all the branches and full git history. What is rationale behind fetching full history? Isn't something like this (or some variant which doesn't clones repo with full history) an option?
git clone --depth 1
https://github.com/cljdoc/cljdoc/blob/c12eaae2f40447bc1009af55fbe41566f6d152f3/src/cljdoc/git_repo.clj#L55I think that’s roughly the reason yeah
There might be other ways of getting at the info cljdoc needs without consuming as much RAM for repos with large blobs. But I suppose we’d be optimizing for RAM usage (and as a side effect disk usage, I suppose). If that is worth it (we don’t want to bump up RAM on cljdoc server), we can explore.