[JIRA] [_unsorted] (JENKINS-34969) "Waiting for next available executor on master" though many executors on the master is idle

[sathnaga@linux.vnet.ibm.com (JIRA)]

Satheesh Rajendran created an issue

Jenkins / JENKINS-34969 "Waiting for next available executor on master" though many executors on the master is idle Issue Type: Bug Assignee: Oleg Nenashev Components: _unsorted Created: 2016/May/20 8:30 AM Environment: Fedora 23 ppc64le 4.2.3-300.fc23.ppc64le Jenkins 2.0 Priority: Blocker Reporter: Satheesh Rajendran Though many executors are available, the jobs are getting queued waiting for executor on master collapse Build Queue (11) Project1 Project2 Project4 Project3 Project5 Project6 ... Build Executor Status master 1 Idle 2 Idle 3 Idle 4 Idle 5 Idle 6 Idle 7 Idle 8 Idle 9 Idle 10 Idle 11 Idle 12 Idle 13 Idle 14 Idle 15 Idle Add Comment

This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)

[o.v.nenashev@gmail.com (JIRA)]

Oleg Nenashev commented on JENKINS-34969

Re: "Waiting for next available executor on master" though many executors on the master is idle Please provide... Jenkins log (at least FINE level) List of installed plugins (with versions) Output of Jenkins Queue API with maximum depth. E.g. JENKINS_URL/jenkins/queue/api/json?pretty=true&depth=999

Add Comment

[sathnaga@linux.vnet.ibm.com (JIRA)]

Satheesh Rajendran edited a comment on JENKINS-34969

Re: "Waiting for next available executor on master" though many executors on the master is idle

I doubt I can provide you other two information as it contains confidential information. Safe restart fixed the issue temporarily and it works for even weeks fine with multiple runs, suddenly this issue is seen. List of plugins: ace-editor 1.1 true false all-changes 1.3 true false ant 1.2 true false antisamy-markup-formatter 1.3 true false authentication-tokens 1.2 true false authorize-project 1.2.1 true false backup 1.6.1 true false bootstraped-multi-test-results-report 1.4.9 true false branch-api 1.7 true false bugzilla 1.5 true false build-cause-run-condition 0.1 true false build-env-propagator 1.0 true false build-environment 1.6 true false build-failure-analyzer 1.15.0 true false build-flow-plugin 0.18 true false build-metrics 1.1 true false build-timeout 1.16 true false build-timestamp 1.0.1 true false build-token-root 1.4 true false build-user-vars-plugin 1.5 true false build-with-parameters 1.3 true false built-on-column 1.1 true false cloudbees-folder 5.9 true false cluster-stats 0.4.6 true false compound-slaves 1.2 true false compress-artifacts 1.7 true false conditional-buildstep 1.3.3 true false config-file-provider 2.10.1 true false copy-to-slave 1.4.4 true false copyartifact 1.38 true false credentials 1.28 true false credentials-binding 1.7 true false cvs 2.12 true false dashboard-view 2.9.7 true false delivery-pipeline-plugin 0.9.9 true false disk-usage 0.28 true false docker-plugin 0.16.0 true false downstream-buildview 1.9 true false durable-task 1.9 true false dynamic-search-view 0.2.2 true false dynamicparameter 0.2.0 true false email-ext 2.42 true false emailext-template 0.4 true false envfile 1.2 true false envinject 1.92.1 true false environment-labels-setter 1.1 true false environment-script 1.2.2 true false exclusive-execution 0.8 true false exclusive-label-plugin 1.0 true false extended-choice-parameter 0.72 true false extensible-choice-parameter 1.3.2 true false external-monitor-job 1.4 true false externalresource-dispatcher 1.1.0 true false fail-the-build-plugin 1.0 true false favorite 1.16 true false filesystem-list-parameter-plugin 0.0.3 true false flexible-publish 0.15.2 true false git 2.4.4 true false git-changelog 1.22 true false git-client 1.19.6 true false git-parameter 0.5.1 true false git-server 1.6 true false github 1.19.0 true false github-api 1.75 true false github-branch-source 1.6 true false github-organization-folder 1.3 true false gitlab-plugin 1.1.32 true false global-build-stats 1.3 true false global-variable-string-parameter 1.2 true false groovy 1.29 true false handlebars 1.1.1 true false htmlpublisher 1.11 true false icon-shim 2.0.3 true false instant-messaging 1.35 true false ircbot 2.27 true false javadoc 1.3 true false jenkins-multijob-plugin 1.21 true false job-direct-mail 1.5 true false job-import-plugin 1.3.1 true false job-parameter-summary 0.3 true false job-poll-action-plugin 1.0 true false job-restrictions 0.4 true false jobConfigHistory 2.13 true false jobrequeue 1.0 true false join 1.19 true false jqs-monitoring 1.4 true false jquery 1.11.2-0 true false jquery-detached 1.2.1 true false jquery-ui 1.0.2 true false junit 1.13 true false keepSlaveOffline 1.0 true false label-linked-jobs 4.0.3 true false label-verifier 1.1 true false labeled-test-groups-publisher 1.2.8 true false ldap 1.12 true false ldapemail 0.8 true false libvirt-slave 1.8.5 true false livescreenshot 1.4.5 true false locale 1.2 true false mail-watcher-plugin 1.13 true false mailer 1.17 true false managed-scripts 1.2.1 true false mapdb-api 1.0.6.0 true false matrix-auth 1.3.2 true false matrix-combinations-parameter 1.0.9 true false matrix-project 1.6 true false maven-plugin 2.12.1 true false measurement-plots 0.1 true false metadata 1.1.0b true false mission-control-view 0.9.0 true false modernstatus 1.2 true false momentjs 1.1.1 true false monitoring 1.59.0 true false multi-slave-config-plugin 1.2.0 true false nested-view 1.14 true false next-build-number 1.3 true false next-executions 1.0.11 true false nodelabelparameter 1.7.2 true false notification 1.10 true false offlineonfailure-plugin 1.0 true false ownership 0.8 true false pam-auth 1.2 true false parallel-test-executor 1.8 true false parallels-desktop 0.3 true false parameter-separator 1.0 true false Parameterized-Remote-Trigger 2.2.2 true false parameterized-scheduler 0.2 true false parameterized-trigger 2.30 true false patch-parameter 1.2 true false periodicbackup 1.3 true false persistent-build-queue-plugin 0.1.1 true false persistent-parameter 1.1 true false pipeline-build-step 2.0 true false pipeline-input-step 2.0 true false pipeline-rest-api 1.3 true false pipeline-stage-step 2.1 true false pipeline-stage-view 1.3 true false plain-credentials 1.1 true false plot 1.9 true false poll-mailbox-trigger-plugin 1.022 true false pollscm 1.2 true false PrioritySorter 3.4 true false proc-cleaner-plugin 1.2 true false project-stats-plugin 0.4 true false publish-over-ssh 1.14 true false pyenv 0.0.7 true false python 1.3 true false random-string-parameter 1.0 true false read-only-configurations 1.10 true false readonly-parameters 1.0.0 true false rebuild 1.25 true false role-strategy 2.2.0 true false ruby-runtime 0.12 true false run-condition 1.0 true false run-condition-extras 0.2 true false saferestart 0.3 true false schedule-build 0.3.4 true false scm-api 1.2 true false script-security 1.19 true false scriptler 2.9 true false scripttrigger 0.34 true false selected-tests-executor 1.3.3 true false show-build-parameters 1.0 true false sidebar-link 1.7 true false singleuseslave 1.0.0 true false slave-prerequisites 1.0 true false slave-setup 1.9 true false slave-squatter 1.2 true false slave-status 1.6 true false slave-utilization-plugin 1.8 true false ssh 2.4 true false ssh-credentials 1.11 true false ssh-slaves 1.11 true false startup-trigger-plugin 2.5 true false statusmonitor 1.3 true false structs 1.1 true false subversion 2.5.7 true false systemloadaverage-monitor 1.2 true false tap 1.24 true false team-views 0.9.0 true false teamconcert 1.2.0.0 true false teamconcert-git 1.0.10 true false terminal 1.4 true false test-results-analyzer 0.3.4 true false test-stability 1.0 true false testInProgress 1.4 true false timestamper 1.7.4 true false token-macro 1.12.1 true false toolenv 1.1 true false translation 1.14 true false unreliable-slave-plugin 1.2 true false uptime 1.0 true false vncrecorder 1.25 true false vncviewer 1.5 true false windows-slaves 1.1 true false workflow-aggregator 2.1 true false workflow-api 2.0 true false workflow-basic-steps 2.0 true false workflow-cps 2.2 true false workflow-cps-global-lib 2.0 true false workflow-durable-task-step 2.0 true false workflow-job 2.1 true false workflow-multibranch 2.3 true false workflow-scm-step 2.0 true false workflow-step-api 2.0 true false workflow-support 2.0 true false ws-cleanup 0.29 true false xvnc 1.23 true false ----------- System Info: awt.toolkit sun.awt.X11.XToolkit BUILD_TIMESTAMP 2016-05-16 14:23:06 IST executable-war /usr/lib/jenkins/jenkins.war file.encoding UTF-8 file.encoding.pkg sun.io file.separator / hudson.diyChunking true hudson.util.ProcessTree.disable true java.awt.graphicsenv sun.awt.X11GraphicsEnvironment java.awt.headless true java.awt.printerjob sun.print.PSPrinterJob java.class.path /usr/lib/jenkins/jenkins.war java.class.version 52.0 java.endorsed.dirs /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/endorsed java.ext.dirs /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/ext:/usr/java/packages/lib/ext java.home /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre java.io.tmpdir /tmp java.library.path /usr/java/packages/lib/ppc64le:/usr/lib64:/lib64:/lib:/usr/lib java.runtime.name OpenJDK Runtime Environment java.runtime.version 1.8.0_60-b27 java.specification.name Java Platform API Specification java.specification.vendor Oracle Corporation java.specification.version 1.8 java.vendor Oracle Corporation java.vendor.url http://java.oracle.com/ java.vendor.url.bug http://bugreport.sun.com/bugreport/ java.version 1.8.0_60 java.vm.info mixed mode java.vm.name OpenJDK 64-Bit Server VM java.vm.specification.name Java Virtual Machine Specification java.vm.specification.vendor Oracle Corporation java.vm.specification.version 1.8 java.vm.vendor Oracle Corporation java.vm.version 25.60-b23 javamelody.About Monitoring https://wiki.jenkins-ci.org/display/JENKINS/Monitoring javamelody.analytics-id UA-1335263-7 javamelody.custom-reports Jenkins Info,About Monitoring javamelody.gzip-compression-disabled true javamelody.http-transform-pattern /\d+/|/site/.+|avadoc/.+|/ws/.+|obertura/.+|estReport/.+|iolations/file/.+|/user/.+|/static/\w+/|/adjuncts/\w+/|/bound/[\w\-]+ javamelody.Jenkins Info /systemInfo javamelody.no-database true javamelody.storage-directory //home/jenkins/monitoring javamelody.system-actions-enabled true JENKINS_HOME /home/jenkins jna.loaded true jna.platform.library.path /usr/lib64:/lib64:/usr/lib:/lib:/usr/lib64/iscsi:/usr/lib64/bind99:/usr/lib64/tcl8.6 jnidispatch.path /tmp/jna-3506402/jna4484671688202545920.tmp line.separator mail.smtp.sendpartial true mail.smtps.sendpartial true os.arch ppc64le os.name Linux os.version 4.2.3-300.fc23.ppc64le path.separator : pid 45037 sun.arch.data.model 64 sun.boot.class.path /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/resources.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/rt.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/sunrsasign.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/jsse.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/jce.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/charsets.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/jfr.jar:/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/classes sun.boot.library.path /usr/lib/jvm/java-1.8.0-openjdk-1.8.0.60-14.b27.fc23.ppc64le/jre/lib/ppc64le sun.cpu.endian little sun.cpu.isalist sun.font.fontmanager sun.awt.X11FontManager sun.io.unicode.encoding UnicodeLittle sun.java.command /usr/lib/jenkins/jenkins.war --logfile=/var/log/jenkins/jenkins.log --webroot=/var/cache/jenkins/war --httpPort=8080 --debug=5 --handlerCountMax=100 --handlerCountMaxIdle=20 sun.java.launcher SUN_STANDARD sun.jnu.encoding UTF-8 sun.management.compiler HotSpot 64-Bit Server Compiler sun.os.patch.level unknown svnkit.http.methods Digest,Basic,NTLM,Negotiate svnkit.ssh2.persistent false user.country US user.dir / user.home /root user.language en user.name root user.timezone Asia/Kolkata

Add Comment

[o.v.nenashev@gmail.com (JIRA)]

Oleg Nenashev commented on JENKINS-34969

Re: "Waiting for next available executor on master" though many executors on the master is idle

I see you have the Role Strategy and Authorize Project plugin installed. Does your user have the Computer.Build permission?

Add Comment

[sathnaga@linux.vnet.ibm.com (JIRA)]

Satheesh Rajendran commented on JENKINS-34969

Re: "Waiting for next available executor on master" though many executors on the master is idle

I have LDAP configured for Authorization, have enabled those permission <permission>hudson.model.Computer.Build:xxxx.com</permission> Irrespective of the permission level the job gets queued, if permission seems the issue, safe restart should not solve the issue?

Add Comment

[o.v.nenashev@gmail.com (JIRA)]

Oleg Nenashev commented on JENKINS-34969

Re: "Waiting for next available executor on master" though many executors on the master is idle

Under which user do you run the build? Authorize project changes the build authentication to ANONYMOUS by default IIRC. Use global settings or the job property to alter the behavior

Add Comment

[o.v.nenashev@gmail.com (JIRA)]

Oleg Nenashev resolved as Not A Defect

No response from the requester. According to the last comment, I assume that Jenkins behaves as designed => Not A Defect

Jenkins / JENKINS-34969

"Waiting for next available executor on master" though many executors on the master is idle

Change By: Oleg Nenashev Status: Open Resolved Resolution: Not A Defect

Add Comment

This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c)