[JIRA] [_unsorted] (JENKINS-34774) ClosedChannelException in log (excessive)

65 views
Skip to first unread message

russ@vipasolutions.com (JIRA)

unread,
May 12, 2016, 1:25:01 PM5/12/16
to jenkinsc...@googlegroups.com
Russ Tennant created an issue
 
Jenkins / Bug JENKINS-34774
ClosedChannelException in log (excessive)
Issue Type: Bug Bug
Assignee: Oleg Nenashev
Components: _unsorted
Created: 2016/May/12 5:24 PM
Environment: Jenkins 2.3
java version "1.8.0_40"
Java(TM) SE Runtime Environment (build 1.8.0_40-b26)
Java HotSpot(TM) 64-Bit Server VM (build 25.40-b25, mixed mode)
CentOS release 6.6 (Final)
Priority: Minor Minor
Reporter: Russ Tennant

I just update to version 2 (2.3) and I am getting this logged every second. Any idea on how I can find out what is triggering this? 

May 12, 2016 5:22:53 PM org.apache.http.impl.nio.client.LoggingAsyncRequestExecutor exception
SEVERE: http-outgoing-1 [CLOSED] HTTP protocol exception: null
java.nio.channels.ClosedChannelException
        at sun.nio.ch.SocketChannelImpl.ensureReadOpen(SocketChannelImpl.java:257)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:300)
        at org.apache.http.nio.reactor.ssl.SSLIOSession.receiveEncryptedData(SSLIOSession.java:346)
        at org.apache.http.nio.reactor.ssl.SSLIOSession.isAppInputReady(SSLIOSession.java:377)
        at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:118)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:220)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:284)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:613)
        at java.lang.Thread.run(Thread.java:745)

May 12, 2016 5:22:54 PM org.apache.http.impl.nio.client.LoggingAsyncRequestExecutor exception
SEVERE: http-outgoing-1 [CLOSED] HTTP protocol exception: null
java.nio.channels.ClosedChannelException
        at sun.nio.ch.SocketChannelImpl.ensureReadOpen(SocketChannelImpl.java:257)
        at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:300)
        at org.apache.http.nio.reactor.ssl.SSLIOSession.receiveEncryptedData(SSLIOSession.java:346)
        at org.apache.http.nio.reactor.ssl.SSLIOSession.isAppInputReady(SSLIOSession.java:377)
        at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:118)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:220)
        at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:284)
        at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
        at org.apache.http.impl.nio.reactor.AbstractMultiworkerIORe
Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)
Atlassian logo

russ@vipasolutions.com (JIRA)

unread,
May 18, 2016, 3:14:02 PM5/18/16
to jenkinsc...@googlegroups.com
Russ Tennant commented on Bug JENKINS-34774
 
Re: ClosedChannelException in log (excessive)

I removed the slack plugin and this went away.

o.v.nenashev@gmail.com (JIRA)

unread,
May 26, 2016, 2:25:01 AM5/26/16
to jenkinsc...@googlegroups.com
Oleg Nenashev assigned an issue to Kurt Madel
Change By: Oleg Nenashev
Assignee: Oleg Nenashev Kurt Madel

o.v.nenashev@gmail.com (JIRA)

unread,
May 26, 2016, 2:25:01 AM5/26/16
to jenkinsc...@googlegroups.com
Oleg Nenashev updated an issue
Change By: Oleg Nenashev
Component/s: slack-plugin
Component/s: _unsorted

o.v.nenashev@gmail.com (JIRA)

unread,
May 26, 2016, 2:25:02 AM5/26/16
to jenkinsc...@googlegroups.com

Reassigned it to the Slack plugin

drfeldsine@gmail.com (JIRA)

unread,
Aug 9, 2016, 3:27:06 PM8/9/16
to jenkinsc...@googlegroups.com

I am having the exact same issue; however I do not have the slack plugin installed.

Aug 09, 2016 12:18:30 PM org.apache.http.impl.nio.client.LoggingAsyncRequestExecutor exception
SEVERE: http-outgoing-114 [CLOSED] HTTP protocol exception: null
java.nio.channels.ClosedChannelException
	at sun.nio.ch.SocketChannelImpl.ensureReadOpen(SocketChannelImpl.java:257)
	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:300)
	at org.apache.http.nio.reactor.ssl.SSLIOSession.receiveEncryptedData(SSLIOSession.java:346)
	at org.apache.http.nio.reactor.ssl.SSLIOSession.isAppInputReady(SSLIOSession.java:377)
	at org.apache.http.impl.nio.reactor.AbstractIODispatch.inputReady(AbstractIODispatch.java:118)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.validate(BaseIOReactor.java:220)
	at org.apache.http.impl.nio.reactor.AbstractIOReactor.execute(AbstractIOReactor.java:284)
	at org.apache.http.impl.nio.reactor.BaseIOReactor.execute(BaseIOReactor.java:106)
	at org.apache.http.impl.nio.reactor.AbstractMultiworkerIOReactor$Worker.run(AbstractMultiworkerIOReactor.java:613)
	at java.lang.Thread.run(Thread.java:745)

awt.toolkit	sun.awt.X11.XToolkit
com.sun.org.apache.xml.internal.dtm.DTMManager	com.sun.org.apache.xml.internal.dtm.ref.DTMManagerDefault
executable-war	/usr/lib/jenkins/jenkins.war
file.encoding	UTF-8
file.encoding.pkg	sun.io
file.separator	/
hudson.diyChunking	true
java.awt.graphicsenv	sun.awt.X11GraphicsEnvironment
java.awt.headless	true
java.awt.printerjob	sun.print.PSPrinterJob
java.class.path	/usr/lib/jenkins/jenkins.war
java.class.version	52.0
java.endorsed.dirs	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/endorsed
java.ext.dirs	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/ext:/usr/java/packages/lib/ext
java.home	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre
java.io.tmpdir	/tmp
java.library.path	/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
java.runtime.name	OpenJDK Runtime Environment
java.runtime.version	1.8.0_77-b03
java.specification.name	Java Platform API Specification
java.specification.vendor	Oracle Corporation
java.specification.version	1.8
java.vendor	Oracle Corporation
java.vendor.url	http://java.oracle.com/
java.vendor.url.bug	http://bugreport.sun.com/bugreport/
java.version	1.8.0_77
java.vm.info	mixed mode
java.vm.name	OpenJDK 64-Bit Server VM
java.vm.specification.name	Java Virtual Machine Specification
java.vm.specification.vendor	Oracle Corporation
java.vm.specification.version	1.8
java.vm.vendor	Oracle Corporation
java.vm.version	25.77-b03
javamelody.About Monitoring	https://wiki.jenkins-ci.org/display/JENKINS/Monitoring
javamelody.analytics-id	UA-1335263-7
javamelody.custom-reports	Jenkins Info,About Monitoring
javamelody.gzip-compression-disabled	true
javamelody.http-transform-pattern	/\d+/|/site/.+|avadoc/.+|/ws/.+|obertura/.+|estReport/.+|iolations/file/.+|/user/.+|/static/\w+/|/adjuncts/\w+/|/bound/[\w\-]+
javamelody.Jenkins Info	/systemInfo
javamelody.no-database	true
javamelody.storage-directory	//var/lib/jenkins/monitoring
javamelody.system-actions-enabled	true
javax.xml.parsers.DocumentBuilderFactory	com.sun.org.apache.xerces.internal.jaxp.DocumentBuilderFactoryImpl
JENKINS_HOME	/var/lib/jenkins
jna.loaded	true
jna.platform.library.path	/usr/lib64:/lib64:/usr/lib:/lib:/usr/lib64/mysql
jnidispatch.path	/tmp/jna--1712433994/jna7801115753037248603.tmp
line.separator	
mail.smtp.sendpartial	true
mail.smtps.sendpartial	true
org.apache.xml.security.ignoreLineBreaks	true
os.arch	amd64
os.name	Linux
os.version	3.10.0-327.13.1.el7.x86_64
path.separator	:
pid	2140
sun.arch.data.model	64
sun.boot.class.path	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/resources.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/rt.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/jsse.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/jce.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/charsets.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/jfr.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/classes
sun.boot.library.path	/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.77-0.b03.el7_2.x86_64/jre/lib/amd64
sun.cpu.endian	little
sun.cpu.isalist	
sun.font.fontmanager	sun.awt.X11FontManager
sun.io.unicode.encoding	UnicodeLittle
sun.java.command	/usr/lib/jenkins/jenkins.war --logfile=/var/log/jenkins/jenkins.log --webroot=/var/cache/jenkins/war --httpPort=8080 --ajp13Port=8009 --debug=9 --handlerCountMax=100 --handlerCountMaxIdle=20
sun.java.launcher	SUN_STANDARD
sun.jnu.encoding	UTF-8
sun.management.compiler	HotSpot 64-Bit Tiered Compilers
sun.os.patch.level	unknown
svnkit.http.methods	Digest,Basic,NTLM,Negotiate
svnkit.ssh2.persistent	false
user.country	US
user.dir	/
user.home	/var/lib/jenkins
user.language	en
user.name	jenkins
user.timezone	America/Los_Angeles
Environment Variables

Name  ↓
Value   
_	/etc/alternatives/java
HOME	/var/lib/jenkins
LANG	en_US.UTF-8
LOGNAME	jenkins
NLSPATH	/usr/dt/lib/nls/msg/%L/%N.cat
PATH	/sbin:/usr/sbin:/bin:/usr/bin
PWD	/
SHELL	/bin/bash
SHLVL	2
USER	jenkins
XFILESEARCHPATH	/usr/dt/app-defaults/%L/Dt
Plugins

Name  ↓
Version   
Enabled   
Pinned   
analysis-core	1.78	true	false
ant	1.2	true	false
antisamy-markup-formatter	1.1	true	false
aws-java-sdk	1.10.45	true	false
build-timeout	1.16	true	false
checkstyle	3.46	true	false
claim	2.8	true	false
cloudbees-folder	5.7	true	false
conditional-buildstep	1.3.3	true	false
copyupstreamchanges-release	2.0.6	true	false
credentials	1.26	true	true
cvs	2.11	true	false
ec2	1.31	true	false
email-ext	2.41.3	true	false
envinject	1.92.1	true	false
extended-read-permission	1.0	true	false
external-monitor-job	1.4	true	false
gerrit-trigger	2.19.0	true	false
git	2.4.4	true	false
git-client	1.19.6	true	false
google-login	1.2.1	true	false
icon-shim	2.0.3	true	false
jackson2-api	2.7.3	true	false
javadoc	1.1	true	false
jenkins-jira-issue-updater	1.18	true	false
jenkins-multijob-plugin	1.21	true	false
jira	2.2.1	true	false
job-dsl	1.44	true	false
jobConfigHistory	2.13	true	false
junit	1.11	true	true
ldap	1.11	true	false
mailer	1.16	true	true
matrix-auth	1.3.2	true	true
matrix-project	1.6	true	true
maven-plugin	2.10-SNAPSHOT (private-50aa9f79-michaelsawyer)	true	true
monitoring	1.59.0	true	false
next-build-number	1.3	true	false
node-iterator-api	1.5	true	false
pam-auth	1.1	true	false
parameterized-trigger	2.30	true	false
postbuild-task	1.8	true	false
publish-over-ssh	1.14	true	false
run-condition	1.0	true	false
saml	0.5	true	false
scm-api	1.1	true	false
script-security	1.13	true	false
ssh-credentials	1.11	true	true
ssh-slaves	1.10	true	true
subversion	1.54	true	false
thinBackup	1.7.4	true	false
timestamper	1.7.4	true	false
token-macro	1.12.1	true	false
translation	1.10	true	false
warnings	4.56	true	false
windows-slaves	1.0	true	false
This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c)
Atlassian logo

o.v.nenashev@gmail.com (JIRA)

unread,
Aug 9, 2016, 3:38:01 PM8/9/16
to jenkinsc...@googlegroups.com

ClosedChannelException is a valid behavior in the case of network issues

russ@vipasolutions.com (JIRA)

unread,
Aug 9, 2016, 3:55:01 PM8/9/16
to jenkinsc...@googlegroups.com

The main issue for me, was I could find no way to determine what was causing the issue. There isn't enough information logged.

russ@vipasolutions.com (JIRA)

unread,
Aug 9, 2016, 3:56:01 PM8/9/16
to jenkinsc...@googlegroups.com
Russ Tennant edited a comment on Bug JENKINS-34774
The main issue for me, was I could find no way to determine what was causing the issue. There isn't enough information logged. That, and it logged so much information I had to stop jenkins and clear the log periodically to avoid filling the disk.

drfeldsine@gmail.com (JIRA)

unread,
Aug 10, 2016, 11:47:01 AM8/10/16
to jenkinsc...@googlegroups.com

I agree with Russ, from a Jenkins perspective the issue is that there does not appear to be any way to determine the destination for this failure. I have changed the debug level to 9; however this does not appear to have any impact on the contents of the Jenkins log. Until I can figure out the destination (plugin) I am at a loss.

Once I am able to determine the plugin, I can open a ticket with them for why I am getting 300,000+ of these per day. They are doing retries on multiple failures every second and they never give up.

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 4:10:01 AM9/28/16
to jenkinsc...@googlegroups.com

By the way, is your instance behind Apache?

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 4:11:02 AM9/28/16
to jenkinsc...@googlegroups.com
Oleg Nenashev assigned an issue to Unassigned
Change By: Oleg Nenashev
Assignee: Kurt Madel

russ@vipasolutions.com (JIRA)

unread,
Sep 28, 2016, 11:13:02 AM9/28/16
to jenkinsc...@googlegroups.com

In my case, I am behind Apache HTTPD.

paul.oflynn@veeva.com (JIRA)

unread,
Sep 28, 2016, 2:05:03 PM9/28/16
to jenkinsc...@googlegroups.com

I am behind nginx and this msg is flooding my log so it is more than a 'minor' bug

paul.oflynn@veeva.com (JIRA)

unread,
Sep 28, 2016, 2:08:03 PM9/28/16
to jenkinsc...@googlegroups.com
Paul O'Flynn edited a comment on Bug JENKINS-34774
I am behind nginx and this msg is flooding my log so it is more than a 'minor' bug :-(

Edit: My env info is:
openjdk 1.8.0_77
CentOS 7.2
Jenkins 1.642.4
nginx 1.6.3

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 2:09:04 PM9/28/16
to jenkinsc...@googlegroups.com

I have a support bundle (Support Core plugin) from one of the affected instances, but there is nothing helpful there. Likely a Jenkins 2 regression

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 2:09:05 PM9/28/16
to jenkinsc...@googlegroups.com
Oleg Nenashev edited a comment on Bug JENKINS-34774
I have a support bundle (Support Core plugin) from one of the affected instances, but there is nothing helpful there. Likely a Jenkins 2 1.609.3+ regression

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 2:09:09 PM9/28/16
to jenkinsc...@googlegroups.com
Oleg Nenashev updated an issue
Change By: Oleg Nenashev
Component/s: core
Component/s: slack-plugin

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 2:09:09 PM9/28/16
to jenkinsc...@googlegroups.com
Oleg Nenashev updated an issue
Change By: Oleg Nenashev
Priority: Minor Critical

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 28, 2016, 2:09:09 PM9/28/16
to jenkinsc...@googlegroups.com
Oleg Nenashev assigned an issue to Oleg Nenashev
Change By: Oleg Nenashev
Assignee: Oleg Nenashev

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 29, 2016, 3:07:04 AM9/29/16
to jenkinsc...@googlegroups.com

Just a summary of what I've found in Google:

So if somebody of you sends usernames over the channel, please step forward

o.v.nenashev@gmail.com (JIRA)

unread,
Sep 29, 2016, 3:09:01 AM9/29/16
to jenkinsc...@googlegroups.com
Oleg Nenashev edited a comment on Bug JENKINS-34774
Just a summary of what I've found in Google:
* Same issue, likely caused by a special character in username: https://ecosystem.atlassian.net/browse/JCAL-197
* Discussion with the component maintainer, he recommends upgrading the lib: http://httpcomponents.10934.n7.nabble.com/HttpAsyncRequestExecutor-HTTP-protocol-exception-null-td27153.html (no fix confirmtion)
* Something about JIRA, issue was likely related to certificates: https://answers.atlassian.com/questions/305588/logs-flooded-with-ssl-errors (Referenced JIRA KB is not available anymore)

So if somebody of you sends usernames *with non-ASCII symbols* over the channel, please step forward :)

w.prabucki+jenkins@gmail.com (JIRA)

unread,
Feb 9, 2017, 2:22:02 PM2/9/17
to jenkinsc...@googlegroups.com

The problem still exists.
I am using Jenkins ver. 2.32.1 and recently our proxy server has been switched off. The logs are flooded with meaningless exceptions. There is no hint what is causing the problem.
No non ASCII URLs or secured/insecure sites are involved.
No idea what is causing the problems.

aheritier@apache.org (JIRA)

unread,
Mar 2, 2017, 12:03:06 PM3/2/17
to jenkinsc...@googlegroups.com
Arnaud Héritier updated an issue
Change By: Arnaud Héritier
Component/s: jira-plugin

aheritier@apache.org (JIRA)

unread,
Mar 2, 2017, 12:03:07 PM3/2/17
to jenkinsc...@googlegroups.com

I confirm that this issue seems to be essentially due to the jira plugin when your Jira server has either an invalid certificate (you need to fix it) or if you use a self-signed certificate (you need to install the certificate in the Master JVM)

o.v.nenashev@gmail.com (JIRA)

unread,
Mar 4, 2018, 6:07:03 PM3/4/18
to jenkinsc...@googlegroups.com
Oleg Nenashev assigned an issue to Unassigned
Change By: Oleg Nenashev
Assignee: Oleg Nenashev
This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)
Atlassian logo

o.v.nenashev@gmail.com (JIRA)

unread,
Mar 4, 2018, 6:11:07 PM3/4/18
to jenkinsc...@googlegroups.com

Thirumurugan Dhasappan whatever was your request, it should have been reported as a separate ticket

According to Arnaud Héritier's above, I am removing Jenkins Core from equation. Note that JIRA plugin is generally unreliable on Jenkins instances due to JENKINS-48357.

o.v.nenashev@gmail.com (JIRA)

unread,
Mar 4, 2018, 6:11:07 PM3/4/18
to jenkinsc...@googlegroups.com
Oleg Nenashev updated an issue
Change By: Oleg Nenashev
Component/s: core

radek.antoniuk@quiddia.com (JIRA)

unread,
May 23, 2019, 4:43:03 AM5/23/19
to jenkinsc...@googlegroups.com
Radek Antoniuk closed an issue as Fixed
 

This should be fixed in jira-plugin 2.5.2. If not, please reopen with current logs from current Jenkins and jira-plugin, thanks!
Change By: Radek Antoniuk
Status: Open Closed
Resolution: Fixed
This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)
Reply all
Reply to author
Forward
0 new messages