Job Failed with "java.lang.OutOfMemoryError: unable to create new native thread" On Kuberentes cluster..

[pbasan...@gmail.com]

Hi All,

While running a job on Kuberentes Cluster 

[EnvInject] - Loading node environment variables.
Building remotely on k8s-prod-cl1-pod1-v1v5j (K8S_PROD_Cl1_lab1) in workspace /workspace/LayerManifestBuilder
java.lang.OutOfMemoryError: unable to create new native thread
	at java.lang.Thread.start0(Native Method)
	at java.lang.Thread.start(Thread.java:717)
	at hudson.remoting.AtmostOneThreadExecutor.execute(AtmostOneThreadExecutor.java:96)

Caused: java.io.IOException: Remote call on JNLP4-connect connection from slc13qka.us.oracle.com/10.247.120.202:35679 failed
	at hudson.remoting.Channel.call(Channel.java:913)
	at hudson.FilePath.act(FilePath.java:987)
Caused: java.io.IOException: remote file operation failed: /scratch/syseng/workspace/LayerManifestBuilder at hudson.remoting.Channel@12301016:JNLP4-connect connection from slc13qka.us.oracle.com/10.247.120.202:35679

Need to find the reason for the failure.



Regards,
Basanta

[Jan Monterrubio]

Cn you check the ulimit for your pod? 

https://plumbr.io/outofmemoryerror/unable-to-create-new-native-thread

--
You received this message because you are subscribed to the Google Groups "Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-use...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/8f49b9a0-af12-475f-8ae6-afb0436c927d%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[pbasan...@gmail.com]

Hi ,

Thanks for your response.

on Ulimit -aH , I can see one difference on container and host 

Container :

open files                      (-n) 65536

Slave Host :

open files                      (-n) 327679

Will that Causeing the OOM Failure .

Regards,

Basanta

[pbasan...@gmail.com]

The same job on rerun after some time passed on the same salve node.. 

[pbasan...@gmail.com]