Hello - I have my own Openshift 1.3 Origin Cluster and im launching Jenkins via s2i template. Jenkins docker image was built close to openshift:jenkinsci (Ben Parees: https://github.com/openshift/jenkins) with few customizations plus Ubuntu OS instead of Centos. When Jenkins is launched, it is filled with Kubernetes errors with unknown host. Although I dont think its a Jenkin bug, im looking for assistance. oc describe pod jenkins-openshift5-6-msta8 Name: jenkins-openshift5-6-msta8 Namespace: atat Security Policy: restricted Node: 192.168.54.105/192.168.54.105 Start Time: Mon, 09 Jan 2017 15:43:04 -0600 Labels: deployment=jenkins-openshift5-6 deploymentconfig=jenkins-openshift5 name=jenkins-openshift5 Status: Running IP: 192.168.194.4 Controllers: ReplicationController/jenkins-openshift5-6 Containers: jenkins: Container ID: docker://7edaa4e1e7969f4dca72a7bd3fde4458d1f98de43612fd5f7ce24446d5913253 Image: 192.168.209.251:5000/atat/jenkins-master-openshift@sha256:3a6829f5675b422d32a396880fc3383376d30d6a49d452f546460c36134b46ec Image ID: docker://f812f7844a03d5bccc63b7a558a8cf170f467e5b6a90850839a52eac00441689 Port: Limits: memory: 2Gi Requests: memory: 2Gi State: Running Started: Mon, 09 Jan 2017 15:44:45 -0600 Ready: True Restart Count: 0 Liveness: http-get http://:8080/login delay=120s timeout=3s period=10s #success=1 #failure=30 Readiness: http-get http://:8080/login delay=3s timeout=3s period=10s #success=1 #failure=3 Volume Mounts: /var/lib/jenkins from jenkins-openshift5-data (rw) /var/run/secrets/kubernetes.io/serviceaccount from jenkins-openshift5-token-flzoj (ro) Environment Variables: OPENSHIFT_ENABLE_OAUTH: false OPENSHIFT_ENABLE_REDIRECT_PROMPT: true KUBERNETES_MASTER: https://kubernetes.default:443 KUBERNETES_TRUST_CERTIFICATES: true JNLP_SERVICE_NAME: jenkins-jnlp5 Conditions: Type Status Initialized True Ready True PodScheduled True Volumes: jenkins-openshift5-data: Type: EmptyDir (a temporary directory that shares a pod's lifetime) Medium: jenkins-openshift5-token-flzoj: Type: Secret (a volume populated by a Secret) SecretName: jenkins-openshift5-token-flzoj QoS Tier: Burstable Events: FirstSeen LastSeen Count From SubobjectPath Type Reason Message --------- -------- ----- ---- ------------- -------- ------ ------- 26m 26m 1 {default-scheduler } Normal Scheduled Successfully assigned jenkins-openshift5-6-msta8 to 192.168.54.105 26m 26m 1 {kubelet 192.168.54.105} spec.containers{jenkins} Normal Pulling pulling image "192.168.209.251:5000/atat/jenkins-master-openshift@sha256:3a6829f5675b422d32a396880fc3383376d30d6a49d452f546460c36134b46ec" 24m 24m 1 {kubelet 192.168.54.105} spec.containers {jenkins} Normal Pulled Successfully pulled image "192.168.209.251:5000/atat/jenkins-master-openshift@sha256:3a6829f5675b422d32a396880fc3383376d30d6a49d452f546460c36134b46ec" 24m 24m 1 {kubelet 192.168.54.105} spec.containers{jenkins} Normal Created Created container with docker id 7edaa4e1e796 24m 24m 1 {kubelet 192.168.54.105} spec.containers{jenkins} Normal Started Started container with docker id 7edaa4e1e796 24m 22m 10 {kubelet 192.168.54.105} spec.containers {jenkins} Warning Unhealthy Readiness probe failed: Get http://192.168.194.4:8080/login: dial tcp 192.168.194.4:8080: getsockopt: connection refused 22m 22m 1 {kubelet 192.168.54.105} spec.containers{jenkins} Warning Unhealthy Readiness probe failed: Get http://192.168.194.4:8080/login: net/http: request canceled (Client.Timeout exceeded while awaiting headers) 22m 22m 1 {kubelet 192.168.54.105} spec.containers{jenkins} Warning Unhealthy Liveness probe failed: Get http://192.168.194.4:8080/login: net/http: request canceled (Client.Timeout exceeded while awaiting headers) 22m 21m 5 {kubelet 192.168.54.105} spec.containers {jenkins} Warning Unhealthy Readiness probe failed: HTTP probe failed with statuscode: 503 22m 21m 3 {kubelet 192.168.54.105} spec.containers{jenkins} Warning Unhealthy Liveness probe failed: HTTP probe failed with statuscode: 503 [root@master1-openshift-prod centos]# Logs from oc logs <jenkins_pod> Unable to connect to the server: dial tcp: lookup openshift.default.svc.cluster.local: no such host Unable to connect to the server: dial tcp: lookup openshift.default.svc.cluster.local: no such host Generating kubernetes-plugin configuration (/opt/openshift/configuration/config.xml.tpl) ... Generating kubernetes-plugin credentials (/var/lib/jenkins/credentials.xml.tpl) ... Copying Jenkins configuration to /var/lib/jenkins ... Copying 81 Jenkins plugins to /var/lib/jenkins ... Creating initial Jenkins 'admin' user ... Running from: /usr/share/jenkins/jenkins.war webroot: EnvVars.masterEnvVars.get("JENKINS_HOME") Jan 09, 2017 9:46:25 PM Main deleteWinstoneTempContents WARNING: Failed to delete the temporary Winstone file /tmp/winstone/jenkins.war Jan 09, 2017 9:46:25 PM org.eclipse.jetty.util.log.JavaUtilLog info INFO: Logging initialized @836ms Jan 09, 2017 9:46:25 PM winstone.Logger logInternal INFO: Beginning extraction from war file Jan 09, 2017 9:46:28 PM org.eclipse.jetty.util.log.JavaUtilLog warn WARNING: Empty contextPath Jan 09, 2017 9:46:28 PM org.eclipse.jetty.util.log.JavaUtilLog info INFO: jetty-9.2.z-SNAPSHOT Jan 09, 2017 9:46:30 PM org.eclipse.jetty.util.log.JavaUtilLog info INFO: NO JSP Support for /, did not find org.eclipse.jetty.jsp.JettyJspServlet Jenkins home directory: /var/lib/jenkins found at: EnvVars.masterEnvVars.get("JENKINS_HOME") Jan 09, 2017 9:46:31 PM org.eclipse.jetty.util.log.JavaUtilLog info INFO: Started w.@73db4768 {/,file:/var/lib/jenkins/war/,AVAILABLE} {/var/lib/jenkins/war} Jan 09, 2017 9:46:31 PM org.eclipse.jetty.util.log.JavaUtilLog info INFO: Started ServerConnector@4de41af9 {HTTP/1.1} {0.0.0.0:8080} Jan 09, 2017 9:46:31 PM org.eclipse.jetty.util.log.JavaUtilLog info INFO: Started @6459ms Jan 09, 2017 9:46:31 PM winstone.Logger logInternal INFO: Winstone Servlet Engine v2.0 running: controlPort=disabled Jan 09, 2017 9:46:32 PM jenkins.InitReactorRunner$1 onAttained INFO: Started initialization Jan 09, 2017 9:46:45 PM jenkins.InitReactorRunner$1 onAttained INFO: Listed all plugins Jan 09, 2017 9:46:45 PM ruby.RubyRuntimePlugin start INFO: Injecting JRuby into XStream Trying to load models from /var/lib/jenkins/plugins/rvm/WEB-INF/classes/models Loading /var/lib/jenkins/plugins/rvm/WEB-INF/classes/models/rvm_wrapper.rb Jan 09, 2017 9:46:57 PM org.jvnet.hudson.plugins.m2release.M2ReleaseBuildWrapper$DescriptorImpl <clinit> INFO: Using new style Permission with PermissionScope Jan 09, 2017 9:47:07 PM jenkins.InitReactorRunner$1 onAttained INFO: Prepared all plugins Jan 09, 2017 9:47:07 PM com.openshift.jenkins.plugins.pipeline.JenkinsServletFilter doFilter INFO: OpenShift Pipeline: derived root URL: http://192.168.194.4:8080/ Jan 09, 2017 9:47:07 PM com.openshift.jenkins.plugins.pipeline.JenkinsServletFilter doFilter INFO: OpenShift Pipeline: derived root URL: http://192.168.194.4:8080/ null Jan 09, 2017 9:47:11 PM jenkins.InitReactorRunner$1 onAttained INFO: Started all plugins Jan 09, 2017 9:47:11 PM jenkins.InitReactorRunner$1 onAttained INFO: Augmented all extensions Jan 09, 2017 9:47:11 PM io.fabric8.jenkins.openshiftsync.GlobalPluginConfiguration$1 doRun INFO: Waiting for Jenkins to be started Jan 09, 2017 9:47:11 PM io.fabric8.jenkins.openshiftsync.BuildConfigWatcher start INFO: Now handling startup build configs!! Jan 09, 2017 9:47:11 PM jenkins.InitReactorRunner$1 onAttained INFO: Loaded all jobs Jan 09, 2017 9:47:11 PM hudson.model.AsyncPeriodicWork$1 run INFO: Started Download metadata Jan 09, 2017 9:47:12 PM org.jenkinsci.main.modules.sshd.SSHD start INFO: Started SSHD at port 39764 Jan 09, 2017 9:47:13 PM org.springframework.context.support.AbstractApplicationContext prepareRefresh INFO: Refreshing org.springframework.web.context.support.StaticWebApplicationContext@22ad4620: display name [Root WebApplicationContext]; startup date [Mon Jan 09 21:47:14 UTC 2017]; root of context hierarchy Jan 09, 2017 9:47:14 PM org.springframework.context.support.AbstractApplicationContext obtainFreshBeanFactory INFO: Bean factory for application context [org.springframework.web.context.support.StaticWebApplicationContext@22ad4620]: org.springframework.beans.factory.support.DefaultListableBeanFactory@33af2efe Jan 09, 2017 9:47:14 PM org.springframework.beans.factory.support.DefaultListableBeanFactory preInstantiateSingletons INFO: Pre-instantiating singletons in org.springframework.beans.factory.support.DefaultListableBeanFactory@33af2efe: defining beans [filter,legacy]; root of factory hierarchy Jan 09, 2017 9:47:30 PM hudson.WebAppMain$3 run INFO: Jenkins is fully up and running Jan 09, 2017 9:47:34 PM io.fabric8.jenkins.openshiftsync.BuildConfigWatcher$1 doRun SEVERE: Failed to load BuildConfigs: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:57) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:483) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:60) at io.fabric8.jenkins.openshiftsync.BuildConfigWatcher$1.doRun(BuildConfigWatcher.java:87) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.UnknownHostException: kubernetes.default at java.net.InetAddress.getAllByName0(InetAddress.java:1280) at java.net.InetAddress.getAllByName(InetAddress.java:1192) at java.net.InetAddress.getAllByName(InetAddress.java:1126) at okhttp3.Dns$1.lookup(Dns.java:39) at okhttp3.internal.connection.RouteSelector.resetNextInetSocketAddress(RouteSelector.java:172) at okhttp3.internal.connection.RouteSelector.nextProxy(RouteSelector.java:138) at okhttp3.internal.connection.RouteSelector.next(RouteSelector.java:80) at okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:178) at okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129) at okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98) at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at io.fabric8.openshift.client.internal.OpenShiftOAuthInterceptor.intercept(OpenShiftOAuthInterceptor.java:65) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.RealCall.execute(RealCall.java:60) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:235) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:230) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:481) ... 10 more Jan 09, 2017 9:47:34 PM io.fabric8.jenkins.openshiftsync.BuildWatcher$1 doRun SEVERE: Failed to load initial Builds: io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. io.fabric8.kubernetes.client.KubernetesClientException: An error has occurred. at io.fabric8.kubernetes.client.KubernetesClientException.launderThrowable(KubernetesClientException.java:57) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:483) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:60) at io.fabric8.jenkins.openshiftsync.BuildWatcher$1.doRun(BuildWatcher.java:78) at hudson.triggers.SafeTimerTask.run(SafeTimerTask.java:50) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) Caused by: java.net.UnknownHostException: kubernetes.default: unknown error at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method) at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928) at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323) at java.net.InetAddress.getAllByName0(InetAddress.java:1276) at java.net.InetAddress.getAllByName(InetAddress.java:1192) at java.net.InetAddress.getAllByName(InetAddress.java:1126) at okhttp3.Dns$1.lookup(Dns.java:39) at okhttp3.internal.connection.RouteSelector.resetNextInetSocketAddress(RouteSelector.java:172) at okhttp3.internal.connection.RouteSelector.nextProxy(RouteSelector.java:138) at okhttp3.internal.connection.RouteSelector.next(RouteSelector.java:80) at okhttp3.internal.connection.StreamAllocation.findConnection(StreamAllocation.java:178) at okhttp3.internal.connection.StreamAllocation.findHealthyConnection(StreamAllocation.java:129) at okhttp3.internal.connection.StreamAllocation.newStream(StreamAllocation.java:98) at okhttp3.internal.connection.ConnectInterceptor.intercept(ConnectInterceptor.java:42) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.internal.cache.CacheInterceptor.intercept(CacheInterceptor.java:109) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.internal.http.BridgeInterceptor.intercept(BridgeInterceptor.java:93) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RetryAndFollowUpInterceptor.intercept(RetryAndFollowUpInterceptor.java:124) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at io.fabric8.openshift.client.internal.OpenShiftOAuthInterceptor.intercept(OpenShiftOAuthInterceptor.java:65) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:92) at okhttp3.internal.http.RealInterceptorChain.proceed(RealInterceptorChain.java:67) at okhttp3.RealCall.getResponseWithInterceptorChain(RealCall.java:170) at okhttp3.RealCall.execute(RealCall.java:60) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:235) at io.fabric8.kubernetes.client.dsl.base.OperationSupport.handleResponse(OperationSupport.java:230) at io.fabric8.kubernetes.client.dsl.base.BaseOperation.list(BaseOperation.java:481) ... 10 more |