Any Changes in the Jenkins Mirrors?

[Mark Diskin]

Over the last few days I'm getting 503 now.

Looks like a AWS server is now is there an updated list of mirror sites since we have to have each one allowed in our networking security/firewall rules.

nslookup 52.91.151.148
Server:         10.165.20.21
Address:        10.165.20.21#53

Non-authoritative answer:
148.151.91.52.in-addr.arpa      name = ec2-52-91-151-148.compute-1.amazonaws.com.

wget --debug --verbose http://updates.jenkins-ci.org/update-center.json
Setting --verbose (verbose) to 1
DEBUG output created by Wget 1.12 on linux-gnu.

--2016-04-21 10:04:22--  http://updates.jenkins-ci.org/update-center.json
Resolving updates.jenkins-ci.org... 199.193.196.24
Caching updates.jenkins-ci.org => 199.193.196.24
Connecting to updates.jenkins-ci.org|199.193.196.24|:80... connected.
Created socket 3.
Releasing 0x0000000000c92240 (new refcount 1).

---request begin---
GET /update-center.json HTTP/1.0
User-Agent: Wget/1.12 (linux-gnu)
Accept: */*
Host: updates.jenkins-ci.org
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 302 Found
Date: Thu, 21 Apr 2016 14:04:22 GMT
Server: Apache/2.2.14 (Ubuntu)
Location: http://updates.jenkins.io/update-center.json
Vary: Accept-Encoding
Content-Length: 317
Connection: close
Content-Type: text/html; charset=iso-8859-1
Set-Cookie: SERVERID=Local; path=/

---response end---
302 Found

Stored cookie updates.jenkins-ci.org -1 (ANY) / <session> <insecure> [expiry none] SERVERID Local
Location: http://updates.jenkins.io/update-center.json [following]
Closed fd 3
--2016-04-21 10:04:22--  http://updates.jenkins.io/update-center.json
Resolving updates.jenkins.io... 52.91.151.148
Caching updates.jenkins.io => 52.91.151.148
Connecting to updates.jenkins.io|52.91.151.148|:80... connected.
Created socket 3.
Releasing 0x0000000000c93cb0 (new refcount 1).

---request begin---
GET /update-center.json HTTP/1.0
User-Agent: Wget/1.12 (linux-gnu)
Accept: */*
Host: updates.jenkins.io
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 503 Service Unavailable
Content-Type: text/html; charset=UTF-8
Content-Length: 2862
Connection: close
P3P: CP="CAO PSA OUR"
Expires: Thu, 01 Jan 1970 00:00:00 GMT
Cache-Control: no-store, no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache

---response end---
503 Service Unavailable
Closed fd 3
2016-04-21 10:04:22 ERROR 503: Service Unavailable.

[R. Tyler Croy]

(replies inline)

On Thu, 21 Apr 2016, Mark Diskin wrote:

> Over the last few days I'm getting 503 now.
>
> Looks like a AWS server is now is there an updated list of mirror sites
> since we have to have each one allowed in our networking security/firewall
> rules.

Correct, I've migrated some infrastructure to EC2 recently. I recommend using
our DNS, instead of IPs, as the source of your firewall rules. There's a
non-zero chance that this infrastructure will move hosts once more in the next
6 months.


As for the 503 you got, I'm unable to reproduce that myself, here's my request:

wget -O /dev/null --debug --verbose http://updates.jenkins-ci.org/update-center.json

Setting --verbose (verbose) to 1

DEBUG output created by Wget 1.16 on linux-gnu.

URI encoding = ‘UTF-8’
--2016-04-21 12:01:02-- http://updates.jenkins-ci.org/update-center.json
Resolving updates.jenkins-ci.org (updates.jenkins-ci.org)... 199.193.196.24
Caching updates.jenkins-ci.org => 199.193.196.24
Connecting to updates.jenkins-ci.org (updates.jenkins-ci.org)|199.193.196.24|:80... connected.
Created socket 5.
Releasing 0x00000000018abdc0 (new refcount 1).

---request begin---
GET /update-center.json HTTP/1.1
User-Agent: Wget/1.16 (linux-gnu)

Accept: */*
Host: updates.jenkins-ci.org
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 302 Found

Date: Thu, 21 Apr 2016 19:01:03 GMT

Server: Apache/2.2.14 (Ubuntu)
Location: http://updates.jenkins.io/update-center.json
Vary: Accept-Encoding
Content-Length: 317
Connection: close
Content-Type: text/html; charset=iso-8859-1
Set-Cookie: SERVERID=Local; path=/

---response end---
302 Found

Stored cookie updates.jenkins-ci.org -1 (ANY) / <session> <insecure> [expiry none] SERVERID Local

URI content encoding = ‘iso-8859-1’
Location: http://updates.jenkins.io/update-center.json [following]
Closed fd 5
URI content encoding = None
--2016-04-21 12:01:03-- http://updates.jenkins.io/update-center.json
Resolving updates.jenkins.io (updates.jenkins.io)... 52.91.151.148
Caching updates.jenkins.io => 52.91.151.148
Connecting to updates.jenkins.io (updates.jenkins.io)|52.91.151.148|:80... connected.
Created socket 5.
Releasing 0x00000000018ac9c0 (new refcount 1).

---request begin---
GET /update-center.json HTTP/1.1
User-Agent: Wget/1.16 (linux-gnu)

Accept: */*
Host: updates.jenkins.io
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---

HTTP/1.1 301 Moved Permanently
Date: Thu, 21 Apr 2016 19:01:05 GMT
Server: Apache/2.4.7 (Ubuntu)
Location: http://updates.jenkins.io/current/update-center.json
Content-Length: 260
Keep-Alive: timeout=3, max=100
Connection: Keep-Alive
Content-Type: text/html; charset=iso-8859-1

---response end---
301 Moved Permanently
Registered socket 5 for persistent reuse.
URI content encoding = ‘iso-8859-1’
Location: http://updates.jenkins.io/current/update-center.json [following]
Skipping 260 bytes of body: [<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>301 Moved Permanently</title>
</head><body>
<h1>Moved Permanently</h1>
<p>The document has moved <a href="http://updates.jenkins.io/currentSkipping 50 bytes of body: [/update-center.json">here</a>.</p>
</body></html>
] done.
URI content encoding = None
--2016-04-21 12:01:05-- http://updates.jenkins.io/current/update-center.json
Reusing existing connection to updates.jenkins.io:80.
Reusing fd 5.

---request begin---
GET /current/update-center.json HTTP/1.1
User-Agent: Wget/1.16 (linux-gnu)

Accept: */*
Host: updates.jenkins.io
Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---

HTTP/1.1 302 Found
Date: Thu, 21 Apr 2016 19:01:06 GMT
Server: Apache/2.4.7 (Ubuntu)
Location: http://mirrors.jenkins-ci.org/updates/current/update-center.json
Content-Length: 248
Keep-Alive: timeout=3, max=99
Connection: Keep-Alive
Content-Type: text/html; charset=iso-8859-1

---response end---
302 Found
URI content encoding = ‘iso-8859-1’
Location: http://mirrors.jenkins-ci.org/updates/current/update-center.json [following]
Skipping 248 bytes of body: [<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="http://mirrors.jenkins-ci.org/updates/current/update-centeSkipping 37 bytes of body: [r.json">here</a>.</p>
</body></html>
] done.
URI content encoding = None
--2016-04-21 12:01:06-- http://mirrors.jenkins-ci.org/updates/current/update-center.json
conaddr is: 127.0.0.1
Resolving mirrors.jenkins-ci.org (mirrors.jenkins-ci.org)... 52.91.151.148
Caching mirrors.jenkins-ci.org => 52.91.151.148
Releasing 0x00000000018acd00 (new refcount 1).
Found mirrors.jenkins-ci.org in host_name_addresses_map (0x18acd00)
Connecting to mirrors.jenkins-ci.org (mirrors.jenkins-ci.org)|52.91.151.148|:80... connected.
Created socket 6.
Releasing 0x00000000018acd00 (new refcount 1).

---request begin---
GET /updates/current/update-center.json HTTP/1.1
User-Agent: Wget/1.16 (linux-gnu)
Accept: */*
Host: mirrors.jenkins-ci.org

Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---
HTTP/1.1 302 Found

Date: Thu, 21 Apr 2016 19:01:07 GMT
Server: Apache/2.4.7 (Ubuntu)
X-MirrorBrain-Mirror: mirror.xmission.com
X-MirrorBrain-Realm: region
Link: <http://mirrors.jenkins-ci.org/updates/current/update-center.json.meta4>; rel=describedby; type="application/metalink4+xml"
Link: <http://mirror.xmission.com/jenkins/updates/current/update-center.json>; rel=duplicate; pri=1; geo=us
Link: <http://ftp-chi.osuosl.org/pub/jenkins/updates/current/update-center.json>; rel=duplicate; pri=2; geo=us
Link: <http://ftp-nyc.osuosl.org/pub/jenkins/updates/current/update-center.json>; rel=duplicate; pri=3; geo=us
Location: http://mirror.xmission.com/jenkins/updates/current/update-center.json
Content-Length: 253
Keep-Alive: timeout=3, max=100
Connection: Keep-Alive
Content-Type: text/html; charset=iso-8859-1

---response end---
302 Found
Disabling further reuse of socket 5.
Closed fd 5
Registered socket 6 for persistent reuse.
URI content encoding = ‘iso-8859-1’
Location: http://mirror.xmission.com/jenkins/updates/current/update-center.json [following]
Skipping 253 bytes of body: [<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">
<html><head>
<title>302 Found</title>
</head><body>
<h1>Found</h1>
<p>The document has moved <a href="http://mirror.xmission.com/jenkins/updates/current/update-center.json">here</a>.</p>
</body></html>
] done.
URI content encoding = None
--2016-04-21 12:01:07-- http://mirror.xmission.com/jenkins/updates/current/update-center.json
conaddr is: 127.0.0.1
Resolving mirror.xmission.com (mirror.xmission.com)... 198.60.22.13
Caching mirror.xmission.com => 198.60.22.13
Releasing 0x00000000018accd0 (new refcount 1).
Found mirror.xmission.com in host_name_addresses_map (0x18accd0)
Connecting to mirror.xmission.com (mirror.xmission.com)|198.60.22.13|:80... connected.
Created socket 5.
Releasing 0x00000000018accd0 (new refcount 1).

---request begin---
GET /jenkins/updates/current/update-center.json HTTP/1.1
User-Agent: Wget/1.16 (linux-gnu)
Accept: */*
Host: mirror.xmission.com

Connection: Keep-Alive

---request end---
HTTP request sent, awaiting response...
---response begin---

HTTP/1.1 200 OK
Server: nginx/1.4.6 (Ubuntu)
Date: Thu, 21 Apr 2016 19:01:09 GMT
Content-Type: application/json
Content-Length: 1029335
Last-Modified: Sat, 16 Apr 2016 12:51:37 GMT
Connection: keep-alive
ETag: "57123559-fb4d7"
Accept-Ranges: bytes

---response end---
200 OK
Disabling further reuse of socket 6.
Closed fd 6
Registered socket 5 for persistent reuse.
Length: 1029335 (1005K) [application/json]
Saving to: ‘/dev/null’

/dev/null 100%[==================================================================================================================>] 1005K 331KB/s in 3.0s

2016-04-21 12:01:12 (331 KB/s) - ‘/dev/null’ saved [1029335/1029335]

> --
> You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
> To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/0dc9df76-f1f4-491f-a3ac-9f8652919970%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.


- R. Tyler Croy

------------------------------------------------------
Code: <https://github.com/rtyler>
Chatter: <https://twitter.com/agentdero>

% gpg --keyserver keys.gnupg.net --recv-key 3F51E16F
------------------------------------------------------

[Mark Diskin]

That's for the update. The problem we (maybe others) is with our corporate firewalls - at some point the name is lost so they end up having to build rules for each of the mirror'd ip's, That is probably why we are getting the 503 is that it's not making out of our network and been blocked since the new aws ip's are not approved.