JenkinsRule doesn't persist the data file, any hints?

[Victor Martinez]

Hi there,

I'm working on running some kind of functional tests for a shared pipeline library using the JenkinsRule annotation. The shared library works like a charm in production but when running the tests with the JenkinsRule annotation I got some serialisation issues, which are related to the failing to persist the data file: program.dat

I've played with -Djenkins.test.noSpaceInTmpDirs=true but same issue anyway:

Failed to persist /Users/vmartinez/work/src/github.com/x/pipeline-library/target/j h650652882681451078/jobs/echo/builds/1/program.dat

# with jenkins.test.noSpaceInTmpDirs=true

Caused: java.io.IOException: Failed to persist /Users/vmartinez/work/src/github.com/x/pipeline-library/target/jkh1570265291437936261/jobs/echo/builds/1/program.dat

I cannot find what's causing that particular issue since It does happen only when running the tests with the JTH framework.

The whole stacktrace can be seen below:

=== Starting co.x.test.IntegrationTest

   0.035 [id=15] INFO o.jvnet.hudson.test.WarExploder#explode: Picking up existing exploded jenkins.war at /Users/vmartinez/work/src/github.com/x/pipeline-library/target/jenkins-for-test

   0.270 [id=15] INFO o.jvnet.hudson.test.JenkinsRule#createWebServer: Running on http://localhost:53289/jenkins/

   2.213 [id=25] INFO jenkins.InitReactorRunner$1#onAttained: Started initialization

   2.241 [id=46] INFO jenkins.InitReactorRunner$1#onAttained: Listed all plugins

   5.348 [id=33] INFO jenkins.InitReactorRunner$1#onAttained: Prepared all plugins

   5.356 [id=35] INFO jenkins.InitReactorRunner$1#onAttained: Started all plugins

   6.600 [id=35] INFO jenkins.InitReactorRunner$1#onAttained: Augmented all extensions

   6.675 [id=23] INFO jenkins.InitReactorRunner$1#onAttained: Loaded all jobs

   6.731 [id=24] INFO jenkins.InitReactorRunner$1#onAttained: Completed initialization

   6.767 [id=61] INFO hudson.UDPBroadcastThread#run: Cannot listen to UDP port 33,848, skipping: java.net.SocketException: Can't assign requested address

GOT CONTEXT FOR log with info

  12.171 [id=77] WARNING o.j.p.w.cps.CpsThreadGroup#saveProgramIfPossible: program state save failed

an exception which occurred:

in field org.jenkinsci.plugins.pipeline.modeldefinition.withscript.WithScriptScript.script

in object org.jenkinsci.plugins.pipeline.modeldefinition.agent.impl.LabelScript@37db0aae

in field groovy.lang.Closure.delegate

in object org.jenkinsci.plugins.workflow.cps.CpsClosure2@6cf8222c

in field groovy.lang.Closure.delegate

in object org.jenkinsci.plugins.workflow.cps.CpsClosure2@4c7c80fd

in field org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.closures

in object org.jenkinsci.plugins.workflow.cps.CpsThreadGroup@59353721

in object org.jenkinsci.plugins.workflow.cps.CpsThreadGroup@59353721

Caused: java.io.NotSerializableException: log

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:926)

at org.jboss.marshalling.river.BlockMarshaller.doWriteObject(BlockMarshaller.java:65)

at org.jboss.marshalling.river.BlockMarshaller.writeObject(BlockMarshaller.java:56)

at org.jboss.marshalling.MarshallerObjectOutputStream.writeObjectOverride(MarshallerObjectOutputStream.java:50)

at org.jboss.marshalling.river.RiverObjectOutputStream.writeObjectOverride(RiverObjectOutputStream.java:179)

at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:344)

at java.util.LinkedHashMap.internalWriteEntries(LinkedHashMap.java:333)

at java.util.HashMap.writeObject(HashMap.java:1363)

at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.jboss.marshalling.reflect.JDKSpecific$SerMethods.callWriteObject(JDKSpecific.java:156)

at org.jboss.marshalling.reflect.SerializableClass.callWriteObject(SerializableClass.java:191)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1028)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.river.BlockMarshaller.doWriteObject(BlockMarshaller.java:65)

at org.jboss.marshalling.river.BlockMarshaller.writeObject(BlockMarshaller.java:56)

at org.jboss.marshalling.MarshallerObjectOutputStream.writeObjectOverride(MarshallerObjectOutputStream.java:50)

at org.jboss.marshalling.river.RiverObjectOutputStream.writeObjectOverride(RiverObjectOutputStream.java:179)

at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:344)

at com.cloudbees.groovy.cps.SerializableScript.writeObject(SerializableScript.java:26)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.jboss.marshalling.reflect.JDKSpecific$SerMethods.callWriteObject(JDKSpecific.java:156)

at org.jboss.marshalling.reflect.SerializableClass.callWriteObject(SerializableClass.java:191)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1028)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1082)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1040)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1082)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1040)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1082)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1040)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1019)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.river.BlockMarshaller.doWriteObject(BlockMarshaller.java:65)

at org.jboss.marshalling.river.BlockMarshaller.writeObject(BlockMarshaller.java:56)

at org.jboss.marshalling.MarshallerObjectOutputStream.writeObjectOverride(MarshallerObjectOutputStream.java:50)

at org.jboss.marshalling.river.RiverObjectOutputStream.writeObjectOverride(RiverObjectOutputStream.java:179)

at java.io.ObjectOutputStream.writeObject(ObjectOutputStream.java:344)

at java.util.HashMap.internalWriteEntries(HashMap.java:1793)

at java.util.HashMap.writeObject(HashMap.java:1363)

at sun.reflect.GeneratedMethodAccessor43.invoke(Unknown Source)

at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

at java.lang.reflect.Method.invoke(Method.java:498)

at org.jboss.marshalling.reflect.JDKSpecific$SerMethods.callWriteObject(JDKSpecific.java:156)

at org.jboss.marshalling.reflect.SerializableClass.callWriteObject(SerializableClass.java:191)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1028)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.river.RiverMarshaller.doWriteFields(RiverMarshaller.java:1082)

at org.jboss.marshalling.river.RiverMarshaller.doWriteSerializableObject(RiverMarshaller.java:1040)

at org.jboss.marshalling.river.RiverMarshaller.doWriteObject(RiverMarshaller.java:920)

at org.jboss.marshalling.AbstractObjectOutput.writeObject(AbstractObjectOutput.java:58)

at org.jboss.marshalling.AbstractMarshaller.writeObject(AbstractMarshaller.java:111)

at org.jenkinsci.plugins.workflow.support.pickles.serialization.RiverWriter.lambda$writeObject$0(RiverWriter.java:144)

at org.jenkinsci.plugins.scriptsecurity.sandbox.groovy.GroovySandbox.runInSandbox(GroovySandbox.java:237)

at org.jenkinsci.plugins.workflow.support.pickles.serialization.RiverWriter.writeObject(RiverWriter.java:143)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:523)

Caused: java.io.IOException: Failed to persist /Users/vmartinez/work/src/github.com/x/pipeline-library/target/j h650652882681451078/jobs/echo/builds/1/program.dat

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:537)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgram(CpsThreadGroup.java:499)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.saveProgramIfPossible(CpsThreadGroup.java:486)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.run(CpsThreadGroup.java:410)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup.access$200(CpsThreadGroup.java:93)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:282)

at org.jenkinsci.plugins.workflow.cps.CpsThreadGroup$2.call(CpsThreadGroup.java:270)

at org.jenkinsci.plugins.workflow.cps.CpsVmExecutorService$2.call(CpsVmExecutorService.java:66)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at hudson.remoting.SingleLaneExecutorService$1.run(SingleLaneExecutorService.java:131)

at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28)

at jenkins.security.ImpersonatingExecutorService$1.run(ImpersonatingExecutorService.java:59)

at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)

at java.util.concurrent.FutureTask.run(FutureTask.java:266)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)

at java.lang.Thread.run(Thread.java:748)

Any clues?

Thanks

[Jesse Glick]

On Fri, Sep 27, 2019 at 6:28 AM Victor Martinez
<victormar...@gmail.com> wrote:
> an exception which occurred:
> in field org.jenkinsci.plugins.pipeline.modeldefinition.withscript.WithScriptScript.script
> in object org.jenkinsci.plugins.pipeline.modeldefinition.agent.impl.LabelScript@37db0aae

> in …
> Caused: java.io.NotSerializableException: log

Sounds like you have some variable or field named `log` which is the problem.

[Victor Martinez]

Thanks,

That particular step doesn't fail in production but when using the JenkinsRule. After debugging just a bit I think it was some kind of missing plugin dependency. Although the stactrace makes the debug really hard though

[Ivan Fernandez Calvo]

we hit a similar issue testing JobDSL definitions, the workaround is to use a custom TestPluginManager that ignores the detached plugins from the war see https://issues.jenkins.io/browse/JENKINS-60295?focusedCommentId=400912&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-400912