[JIRA] (JENKINS-38697) FATAL: Server deletion attempt failed

1 view
Skip to first unread message

mkovarik@redhat.com (JIRA)

unread,
Oct 4, 2016, 10:04:02 AM10/4/16
to jenkinsc...@googlegroups.com
Michal Kovarik created an issue
 
Jenkins / Bug JENKINS-38697
FATAL: Server deletion attempt failed
Issue Type: Bug Bug
Assignee: Oliver Gondža
Components: openstack-cloud-plugin
Created: 2016/Oct/04 2:03 PM
Environment: Jenkins ver. 1.651.3
Openstack Cloud Plugin 2.11
Priority: Major Major
Reporter: Michal Kovarik

I used 'OpenStack Instance Creation' wrapper.
Jenkins build fails during "Destroying node":

Destroying node: rhel-7.2-3962
FATAL: Server deletion attempt failed:
NovaServer{id=041d6431-1c64-4064-9fb6-d393c0349b8b, name=rhel-7.2-3962, image={id=e14d0aa8-17fb-45c3-b842-056d987acec9, links=[{href=http://10.8.188.11:8774/a31cb90123924c62ab75c3fc2d1a8735/images/e14d0aa8-17fb-45c3-b842-056d987acec9, rel=bookmark}]}, flavor=NovaFlavor{id=3, ephemeral=0, swap=0, rxtx_factor=1.0, is_public=true, links=[GenericLink{href=http://10.8.188.11:8774/a31cb90123924c62ab75c3fc2d1a8735/flavors/3, rel=bookmark}], 
}, status=ACTIVE, diskconfig=MANUAL, userId=5008176a8764449e9a2260845aafab3b, created=Tue Oct 04 15:53:54 CEST 2016, updated=Tue Oct 04 15:54:23 CEST 2016, launched at=Tue Oct 04 15:54:12 CEST 2016, tenantId=a31cb90123924c62ab75c3fc2d1a8735, hostId=9fedfc74bc45e69efeafba99c432e8e72231a3ffe04f49f83e1fac8f, addresses=NovaAddresses{addresses={rtt-jenkins=[NovaAddress{address=172.16.43.187, type=fixed, version=4, macaddr=fa:16:3e:49:70:42, 
}, NovaAddress{address=10.8.181.150, type=floating, version=4, macaddr=fa:16:3e:49:70:42, 
}]}, 
}, powerstate=1, vmState=active, metadata={jenkins-template-name=rhel-7.2, jenkins-instance=http://127.0.0.1:8080/}}
jenkins.plugins.openstack.compute.internal.Openstack$ActionFailed: Server deletion attempt failed:
NovaServer{id=041d6431-1c64-4064-9fb6-d393c0349b8b, name=rhel-7.2-3962, image={id=e14d0aa8-17fb-45c3-b842-056d987acec9, links=[{href=http://10.8.188.11:8774/a31cb90123924c62ab75c3fc2d1a8735/images/e14d0aa8-17fb-45c3-b842-056d987acec9, rel=bookmark}]}, flavor=NovaFlavor{id=3, ephemeral=0, swap=0, rxtx_factor=1.0, is_public=true, links=[GenericLink{href=http://10.8.188.11:8774/a31cb90123924c62ab75c3fc2d1a8735/flavors/3, rel=bookmark}], 
}, status=ACTIVE, diskconfig=MANUAL, userId=5008176a8764449e9a2260845aafab3b, created=Tue Oct 04 15:53:54 CEST 2016, updated=Tue Oct 04 15:54:23 CEST 2016, launched at=Tue Oct 04 15:54:12 CEST 2016, tenantId=a31cb90123924c62ab75c3fc2d1a8735, hostId=9fedfc74bc45e69efeafba99c432e8e72231a3ffe04f49f83e1fac8f, addresses=NovaAddresses{addresses={rtt-jenkins=[NovaAddress{address=172.16.43.187, type=fixed, version=4, macaddr=fa:16:3e:49:70:42, 
}, NovaAddress{address=10.8.181.150, type=floating, version=4, macaddr=fa:16:3e:49:70:42, 
}]}, 
}, powerstate=1, vmState=active, metadata={jenkins-template-name=rhel-7.2, jenkins-instance=http://127.0.0.1:8080/}}
	at jenkins.plugins.openstack.compute.internal.Openstack.destroyServer(Openstack.java:307)
	at jenkins.plugins.openstack.compute.internal.TerminateNodes.destroy(TerminateNodes.java:41)
	at jenkins.plugins.openstack.compute.internal.TerminateNodes.apply(TerminateNodes.java:31)
	at jenkins.plugins.openstack.compute.JCloudsBuildWrapper$2.tearDown(JCloudsBuildWrapper.java:85)
	at hudson.model.Build$BuildExecution.doRun(Build.java:173)
	at hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:534)
	at hudson.model.Run.execute(Run.java:1738)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:98)
	at hudson.model.Executor.run(Executor.java:410)
Finished: FAILURE

VM is successfully deleted from OpenStack and also floating IP is released.
This issue is random, reproducibility is around 30%.

Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c)
Atlassian logo

ungoliant@gmail.com (JIRA)

unread,
Jan 6, 2017, 5:57:01 AM1/6/17
to jenkinsc...@googlegroups.com
Telegrapher Bug Report commented on Bug JENKINS-38697
 
Re: FATAL: Server deletion attempt failed

I can reproduce the same bug in version 2.15 and without using Floating IPs.

ogondza@gmail.com (JIRA)

unread,
Jan 6, 2017, 6:08:01 AM1/6/17
to jenkinsc...@googlegroups.com

Deleting server is a nightmare that requires several retries and still fail occasionally. I am working on a change to delay the server deletion so the build will complete and Jenkins will track the dying server for as long as it needs to get properly deleted without bothering users this way.

ogondza@gmail.com (JIRA)

unread,
Feb 22, 2017, 7:33:01 AM2/22/17
to jenkinsc...@googlegroups.com
Oliver Gondža resolved as Fixed
 

Since 2.18, the deletion happens asynchronously so it should not clutter your build log any longer.

Change By: Oliver Gondža
Status: Open Resolved
Resolution: Fixed
Reply all
Reply to author
Forward
0 new messages