HTTPError: 503 Server Error: Service Unavailable for url

1,647 views
Skip to first unread message

cxuha...@gmail.com

unread,
Jan 14, 2018, 9:14:12 PM1/14/18
to Nexus Users
Hi, I met a problem when updating pypi to nexus3. I have followed the instructions on https://support.sonatype.com/hc/en-us/articles/213464668-Troubleshooting-Artifact-Deployment-Failures, but I failed to figure out the problem. 
Following is the log file on server:
2018-01-15 00:00:00,008+0000 INFO  [quartz-3-thread-19]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Task log cleanup' [tasklog.cleanup] state change WAITING -> RUNNING
2018-01-15 00:00:00,007+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 00:00:00,010+0000 INFO  [quartz-3-thread-19]  *SYSTEM org.sonatype.nexus.tasklog.TaskLogCleanup - Cleaning up log files in /nexus-data/log/tasks older than 30 days
2018-01-15 00:00:00,012+0000 INFO  [quartz-3-thread-19]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Task log cleanup' [tasklog.cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:00:00,063+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:04:16,774+0000 INFO  [SessionValidationThread-1]  *UNKNOWN org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Validating all active sessions...
2018-01-15 00:04:16,774+0000 INFO  [SessionValidationThread-1]  *UNKNOWN org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Finished session validation.  No sessions were stopped.
2018-01-15 00:10:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 00:10:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:20:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 00:20:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:30:00,004+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 00:30:00,010+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:40:00,004+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 00:40:00,010+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:50:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 00:50:00,010+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 00:57:55,843+0000 INFO  [qtp692588961-46251]  admin org.sonatype.nexus.rapture.internal.security.SessionServlet - Created session for user: admin
2018-01-15 01:00:00,004+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 01:00:00,009+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 01:04:16,774+0000 INFO  [SessionValidationThread-1]  *UNKNOWN org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Validating all active sessions...
2018-01-15 01:04:16,774+0000 INFO  [SessionValidationThread-1]  *UNKNOWN org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Finished session validation.  No sessions were stopped.
2018-01-15 01:10:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 01:10:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 01:11:14,992+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: nuget.org-proxy' [healthcheck] state change WAITING -> RUNNING
2018-01-15 01:11:15,035+0000 WARN  [quartz-3-thread-20]  *SYSTEM com.sonatype.insight.scan.client.DefaultClientScanner - Could not locate client info descriptor
2018-01-15 01:11:16,475+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.scheduling.internal.TaskSchedulerImpl - Task 'Health Check: nuget.org-proxy' [healthcheck] scheduled: hourly
2018-01-15 01:11:16,477+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: nuget.org-proxy' [healthcheck] state change RUNNING -> WAITING (OK)
2018-01-15 01:11:21,424+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: maven-central' [healthcheck] state change WAITING -> RUNNING
2018-01-15 01:11:21,429+0000 WARN  [quartz-3-thread-20]  *SYSTEM com.sonatype.insight.scan.client.DefaultClientScanner - Could not locate client info descriptor
2018-01-15 01:11:23,487+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.scheduling.internal.TaskSchedulerImpl - Task 'Health Check: maven-central' [healthcheck] scheduled: hourly
2018-01-15 01:11:23,490+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: maven-central' [healthcheck] state change RUNNING -> WAITING (OK)
2018-01-15 01:11:26,470+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: nuget.org-proxy' [healthcheck] state change WAITING -> RUNNING
2018-01-15 01:11:28,533+0000 INFO  [quartz-3-thread-20]  *SYSTEM com.sonatype.nexus.plugins.healthcheck.task.HealthCheckTask - Received health check report for repository nuget.org-proxy
2018-01-15 01:11:28,540+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.scheduling.internal.TaskSchedulerImpl - Task 'Health Check: nuget.org-proxy' [healthcheck] scheduled: hourly
2018-01-15 01:11:28,543+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: nuget.org-proxy' [healthcheck] state change RUNNING -> WAITING (OK)
2018-01-15 01:11:33,483+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: maven-central' [healthcheck] state change WAITING -> RUNNING
2018-01-15 01:11:35,288+0000 INFO  [quartz-3-thread-20]  *SYSTEM com.sonatype.nexus.plugins.healthcheck.task.HealthCheckTask - Received health check report for repository maven-central
2018-01-15 01:11:35,294+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.scheduling.internal.TaskSchedulerImpl - Task 'Health Check: maven-central' [healthcheck] scheduled: hourly
2018-01-15 01:11:35,295+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Health Check: maven-central' [healthcheck] state change RUNNING -> WAITING (OK)
2018-01-15 01:20:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 01:20:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 01:30:00,004+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 01:30:00,010+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 01:40:00,004+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 01:40:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 01:50:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 01:50:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 02:00:00,005+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change WAITING -> RUNNING
2018-01-15 02:00:00,011+0000 INFO  [quartz-3-thread-20]  *SYSTEM org.sonatype.nexus.quartz.internal.task.QuartzTaskInfo - Task 'Storage facet cleanup' [repository.storage-facet-cleanup] state change RUNNING -> WAITING (OK)
2018-01-15 02:04:16,774+0000 INFO  [SessionValidationThread-1]  *UNKNOWN org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Validating all active sessions...
2018-01-15 02:04:16,774+0000 INFO  [SessionValidationThread-1]  *UNKNOWN org.apache.shiro.session.mgt.AbstractValidatingSessionManager - Finished session validation.  No sessions were stopped.
 Do you have any ideas? Thank you

Michael Prescott

unread,
Jan 15, 2018, 9:58:20 AM1/15/18
to cxuha...@gmail.com, Nexus Users
What is the specific symptom of the problem you're having?

--
You received this message because you are subscribed to the Google Groups "Nexus Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.
To post to this group, send email to nexus...@glists.sonatype.com.
To view this discussion on the web visit https://groups.google.com/a/glists.sonatype.com/d/msgid/nexus-users/20e7bbee-3b93-4cb7-af9d-a8b8beac69e7%40glists.sonatype.com.
For more options, visit https://groups.google.com/a/glists.sonatype.com/d/optout.

cxuha...@gmail.com

unread,
Jan 15, 2018, 8:15:45 PM1/15/18
to Nexus Users, cxuha...@gmail.com
I do the following things.
export TWINE_USERNAME=admin
export TWINE_PASSWORD=1234qwer!@#$QWER
And then use twine to upload a wheel I built.
Then it just throw 503
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users...@glists.sonatype.com.

Peter Lynch

unread,
Jan 16, 2018, 3:15:17 PM1/16/18
to cxuha...@gmail.com, Nexus Users
On Mon, Jan 15, 2018 at 9:15 PM, <cxuha...@gmail.com> wrote:
I do the following things.
export TWINE_USERNAME=admin
export TWINE_PASSWORD=1234qwer!@#$QWER
And then use twine to upload a wheel I built.
Then it just throw 503

Monitor the nexus request.log ( not nexus.log) and see what request returned 503 status code. 
To unsubscribe from this group and stop receiving emails from it, send an email to nexus-users+unsubscribe@glists.sonatype.com.

To post to this group, send email to nexus...@glists.sonatype.com.

cxuha...@gmail.com

unread,
Jan 17, 2018, 11:17:03 PM1/17/18
to Nexus Users, cxuha...@gmail.com
Thank you. I believe this is the related failure on requset.log. Any ideas?
10.239.4.160 - - [18/Jan/2018:03:34:36 +0000] "POST /repository/pypi-repo/ HTTP/1.1" 401 0 23 "twine/1.9.1 pkginfo/1.4.1 requests/2.13.0 setuptools/20.10.1 requests-toolbelt/0.8.0 tqdm/4.19.5 CPython/3.5.2"
10.239.4.160 - - [18/Jan/2018:03:34:37 +0000] "POST /repository/pypi-repo/ HTTP/1.1" 401 0 7 "twine/1.9.1 pkginfo/1.4.1 requests/2.13.0 setuptools/20.10.1 requests-toolbelt/0.8.0 tqdm/4.19.5 CPython/3.5.2"
10.239.4.80 - - [18/Jan/2018:03:34:39 +0000] "POST /repository/pypi-repo/ HTTP/1.1" 401 0 6 "twine/1.9.1 pkginfo/1.4.1 requests/2.13.0 setuptools/20.10.1 requests-toolbelt/0.8.0 tqdm/4.19.5 CPython/3.5.2"
10.239.4.80 - - [18/Jan/2018:03:34:40 +0000] "POST /repository/pypi-repo/ HTTP/1.1" 401 0 6 "twine/1.9.1 pkginfo/1.4.1 requests/2.13.0 setuptools/20.10.1 requests-toolbelt/0.8.0 tqdm/4.19.5 CPython/3.5.2"
10.239.4.80 - - [18/Jan/2018:03:34:42 +0000] "POST /repository/pypi-repo/ HTTP/1.1" 401 0 6 "twine/1.9.1 pkginfo/1.4.1 requests/2.13.0 setuptools/20.10.1 requests-toolbelt/0.8.0 tqdm/4.19.5 CPython/3.5.2"

Rich Seddon

unread,
Jan 18, 2018, 8:45:26 AM1/18/18
to Nexus Users, cxuha...@gmail.com
The logs are showing a 401 coming from Nexus, not a 503.  This means the 503 is coming from something on your network running in front of Nexus.  You'll need to find out what this is, and examine it's logs.  Most likely it is a reverse proxy  such as apache or nginx.

Regarding the 401 (unauthorized), this indicates either no login credentials are sent with the request, or invalid ones are.  Check your python client setup:

Reply all
Reply to author
Forward
0 new messages