[JIRA] (JENKINS-59970) Launching two nodes with similar workspace deletes in use workspaces

2 views
Skip to first unread message

martinn@graphcore.ai (JIRA)

unread,
Oct 29, 2019, 5:45:03 AM10/29/19
to jenkinsc...@googlegroups.com
Martin Nordsletten created an issue
 
Jenkins / Bug JENKINS-59970
Launching two nodes with similar workspace deletes in use workspaces
Issue Type: Bug Bug
Assignee: Unassigned
Components: branch-api-plugin
Created: 2019-10-29 09:44
Environment: Jenkins 2.190.1
branch-api:2.5.4
Labels: workspace_corruption workspace node
Priority: Minor Minor
Reporter: Martin Nordsletten

We run Jenkins with configuration as code in two environments:

  • Dev - For testing changes to our configuration and jobs
  • Prod - Used by all developers

Some jobs are multibranch jobs, and most are normal pipeline jobs. 

We recently started seeing the following message pop up in the multibranch job:

ERROR: missing workspace /localdata/jenkins_workspace/workspace/<job_name> on <node_name>

And we have now tracked this down to being caused by a job running in prod while at the same time someone launching Jenkins locally in their Dev environment. 

After placing an immutable file in the workspace we got the following output in the Jenkins boot: 

WARNING	j.b.WorkspaceLocatorImpl$Collector#onOnline: could not delete workspace /localdata/jenkins_workspace/workspace/<job_name>

So apparently there does not seem to be any sort of check to see if any of the workspaces it decides to delete/clean are actually in use by anyone else. 

Given that we are using two separate Jenkins nodes, and they both connect to the same workspace I admit we might be out of scope here, but I wanted to ask if this is something that can be avoided? does the {{workspace/workspaces.txt }}file have any purpose here?

Having these two almost identical dev/prod environments allows us a good workflow of testing changes before pushing to production.

Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo
Reply all
Reply to author
Forward
0 new messages