Fork me on GitHub
#clojars
<
2017-01-05
>
juhoteperi10:01:53

Any idea what could cause Broken Pipe Exception when deploying to Clojars?

juhoteperi10:01:48

Interestingly build 1436 succeeded and I haven't changed configuration after that

tcrawley17:01:16

@juhoteperi: I don't see any errors in the http://clojars.org logs. I do see entries for the files that were successful, but nothing for the failed jars

tcrawley17:01:10

can you try against http://clojars.org/repo/ instead? http://repo.clojars.org 302's to http://clojars.org/repo/, but something may be causing that initial request to timeout for some reason

tcrawley17:01:23

though you would think that would affect all the files, not just the jars

juhoteperi17:01:44

Could the cdn have size limit?

juhoteperi17:01:03

Though the jars shouldn't be particularly large, 700KB or something

tcrawley17:01:29

hmm, I wonder. maybe there is a limitation there - the full file may be uploaded before the 302 is issued, which would mean 1) the cdn would need to accept the full size, and 2) aether will upload each file twice

tcrawley17:01:58

302'ing may be a bad idea :(

juhoteperi17:01:34

hmm not sure how http works in this case

juhoteperi17:01:38

trying direct url now

juhoteperi17:01:00

direct url works

juhoteperi17:01:12

Could Fastly be configured to just proxy PUT requests to real server?

juhoteperi17:01:31

Based on CDN announcement, there is currently one origin set up for Fastly, Rackspace Cloud Files

juhoteperi18:01:06

I think it would be possible to set up http://clojars.org/repo/ as another origin, and add request rule to direct PUT requests to that and not cache them

juhoteperi18:01:25

Then there wouldn't be need for redirect

tcrawley18:01:41

@juhoteperi: I don't understand, what do you mean by "another origin"? http://clojars.org/repo/ is the canonical deploy url, and the legacy read url. The redir solution that is currently in place is just to support boot, since it doesn't have a concept of two different urls for the same repo

tcrawley18:01:12

the CDN currently doesn't cache anything uploaded to it, it just tries to redirect to http://clojars.org/repo/

tcrawley18:01:43

the http://clojars.org server then uploads to Cloud Files once the upload is complete, then it can be served by the CDN

tcrawley18:01:53

I'll see if I can proxy from the CDN instead of redirect though

tcrawley18:01:04

that may not be an option

juhoteperi18:01:51

Is it normal for maven repos have different read and deploy urls?

juhoteperi18:01:23

We talked about adding support for separate deploy urls on #boot but weren't sure how common this is

tcrawley18:01:53

well, for nexus, you do have different urls, because deploys go to a staging repo first, so you are deploying to that

tcrawley18:01:39

I'm not sure about archiva, but nexus is the primary repo implementation

danielcompton20:01:33

@tcrawley the proxying should be fine, I'm pretty sure Fastly will stream it through without holding onto it all

tcrawley20:01:09

cool, we just need to figure that out

juhoteperi22:01:41

"origin" is the source for CDN, if I understand correctly, currently CDN loads files from Cloud Files

juhoteperi22:01:51

But CDN probably can have several origins

danielcompton23:01:01

@juhoteperi yep, that’s what we want to do I think. To clarify, this is probably what we want to happen: * GET/HEAD requests to Fastly are cacheable and go to Rackspace cloudfiles * POST requests to Fastly are passed straight through to the http://clojars.org webapp