[JIRA] (JENKINS-37739) Plugin not displaying Robot Test Summary correctly if robot framework task running in parallel in pipeline

14 views
Skip to first unread message

ssingh.alu@gmail.com (JIRA)

unread,
Aug 28, 2016, 7:41:02 AM8/28/16
to jenkinsc...@googlegroups.com
shyam singh created an issue
 
Jenkins / Bug JENKINS-37739
Plugin not displaying Robot Test Summary correctly if robot framework task running in parallel in pipeline
Issue Type: Bug Bug
Assignee: jpiironen
Attachments: Robot Test Summary.png
Components: robot-plugin
Created: 2016/Aug/28 11:40 AM
Priority: Critical Critical
Reporter: shyam singh

I am building running my robot framework test case parallel in Jenkins pipeline. However the Robot Test Summary generated post build is not correct, it displaying the count/summary of last finished in parallelism, however it should show the count of individual job. It was merging the report also earlier but that I saved as different name & it worked fine, but still the Robot Test Summary is problem(please not my both suite below have different number of test cases).

suite1:{
try

{ mvn -s /settings.xml install robotframework:run -Dexcludes=inprogress -Dsuites=test1 -DLogFileName=suite1_log.html -DoutputFileName=suite1_output.xml -DreportFileName=suite1_report.html' currentBuild.result = 'SUCCESS' }

catch(any)

{ currentBuild.result = 'FAILURE' throw any }

finally

{ step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite1_log.html', outputFileName: 'suite1_output.xml', reportFileName: 'suite1_report.html']) }

},
suite2:{
try

{ mvn -s /settings.xml robotframework:run -Dexcludes=inprogress -Dsuites=test2 -DLogFileName=suite2_log.html -DoutputFileName=suite2_output.xml -DreportFileName=suite2_report.html' currentBuild.result = 'SUCCESS' }

catch(any)

{ currentBuild.result = 'FAILURE' //sendMail() throw any }

finally

{ step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports/', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite2_log.html', outputFileName: 'suite2_output.xml', reportFileName: 'suite2_report.html']) }
Add Comment Add Comment
 
This message was sent by Atlassian JIRA (v7.1.7#71011-sha1:2526d7c)
Atlassian logo

ssingh.alu@gmail.com (JIRA)

unread,
Aug 28, 2016, 7:43:02 AM8/28/16
to jenkinsc...@googlegroups.com

ssingh.alu@gmail.com (JIRA)

unread,
Aug 28, 2016, 7:44:02 AM8/28/16
to jenkinsc...@googlegroups.com

ssingh.alu@gmail.com (JIRA)

unread,
Aug 28, 2016, 10:23:01 AM8/28/16
to jenkinsc...@googlegroups.com
shyam singh updated an issue
I am building running my robot framework test case parallel in Jenkins pipeline. However the Robot Test Summary generated post build is not correct, it displaying the count/summary  of last finished in parallelism, however it should show the count of individual job. It was merging the report also earlier but that I saved as different name & it worked fine, but still the Robot Test Summary is problem(please not my both suite below have different number of test cases).

   suite1:{
                    try {
         mvn -s /settings.xml install robotframework:run -Dexcludes=inprogress -Dsuites=test1 -DLogFileName=suite1_log.html -DoutputFileName=suite1_output.xml -DreportFileName=suite1_report.html'
                    
                    
                     currentBuild.result = 'SUCCESS'
                    }catch(any){
                     currentBuild.result = 'FAILURE'
                     throw any
                    }finally{
                     step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite1_log.html', outputFileName: 'suite1_output.xml', reportFileName: 'suite1_report.html'])
                    }
    },
   suite2:{
                    try {
         mvn -s /settings.xml robotframework:run -Dexcludes=inprogress -Dsuites=test2 -DLogFileName=suite2_log.html -DoutputFileName=suite2_output.xml -DreportFileName=suite2_report.html'
                    
                     currentBuild.result = 'SUCCESS'
                    }catch(any){
                     currentBuild.result = 'FAILURE'
                     //sendMail()
                     throw any
                    }finally{
                     step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports/', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite2_log.html', outputFileName: 'suite2_output.xml', reportFileName: 'suite2_report.html'])
                    }

ssingh.alu@gmail.com (JIRA)

unread,
Sep 2, 2016, 2:23:01 AM9/2/16
to jenkinsc...@googlegroups.com
shyam singh updated an issue
I am building running my robot framework test case parallel in Jenkins pipeline. However the Robot Test Summary generated post build is not correct, it displaying the count/summary  of last finished in parallelism, however it should show the count of individual job. It was merging overwriting the report also earlier but that I saved as different name & it worked fine, but still the Robot Test Summary is problem(please not my both suite below have different number of test cases).


   suite1:{
                    try {
         mvn -s /settings.xml install robotframework:run -Dexcludes=inprogress -Dsuites=test1 -DLogFileName=suite1_log.html -DoutputFileName=suite1_output.xml -DreportFileName=suite1_report.html'
                    
                    
currentBuild.result = 'SUCCESS'
                    }catch(any){
                     currentBuild.result = 'FAILURE'
                     throw any
                    }finally{
                     step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite1_log.html', outputFileName: 'suite1_output.xml', reportFileName: 'suite1_report.html'])
                    }
    },
   suite2:{
                    try {
         mvn -s /settings.xml robotframework:run -Dexcludes=inprogress -Dsuites=test2 -DLogFileName=suite2_log.html -DoutputFileName=suite2_output.xml -DreportFileName=suite2_report.html'
                    
                     currentBuild.result = 'SUCCESS'
                    }catch(any){
                     currentBuild.result = 'FAILURE'
                     //sendMail()
                     throw any
                    }finally{
                     step([$class: 'RobotPublisher', outputPath:'/source/xxxxxx/target/robotframework-reports/', passThreshold: 0, unstableThreshold: 0, otherFiles: "", logFileName: 'suite2_log.html', outputFileName: 'suite2_output.xml', reportFileName: 'suite2_report.html'])
                    }

iwelch82@gmail.com (JIRA)

unread,
Oct 13, 2016, 4:21:02 PM10/13/16
to jenkinsc...@googlegroups.com

iwelch82@gmail.com (JIRA)

unread,
Oct 13, 2016, 4:21:04 PM10/13/16
to jenkinsc...@googlegroups.com
Ian Welch commented on Bug JENKINS-37739
 
Re: Plugin not displaying Robot Test Summary correctly if robot framework task running in parallel in pipeline

Forewarning: I'm not a Java Developer so I may say stupid things
I'm working on a pull request to resolve this issue. Thus far I have been able to add an optional parameter that defines a path in the Job directory to store the results. I'm also able to properly display the results of each test result file (using the result directory in the summary window. The next, and final, piece of the change is to properly link out to the Report visualization under "Browse Results".
I've pored over the code for the last few days and I think I have identified the this data comes from `RobotResult.java` but I can't for the life of me figure out how the data is populated into this class. Can anyone point me in the proper direction to figure out how this data is populated?
My best guess is that the data is stored in

private transient List<RobotResultStatistics> overallStats;

and populated from

public void setStatsByCategory(List<RobotResultStatistics> statsByCategory) {
		this.overallStats = statsByCategory;
	}

pradeep.p_t@nokia.com (JIRA)

unread,
Mar 27, 2017, 3:52:01 AM3/27/17
to jenkinsc...@googlegroups.com

Is this issue fixed ?

This message was sent by Atlassian JIRA (v7.3.0#73011-sha1:3c73d0e)
Atlassian logo

jpiironen@java.net (JIRA)

unread,
Aug 7, 2018, 5:27:03 AM8/7/18
to jenkinsc...@googlegroups.com

Hi,

We've resumed development of the plugin and currently doing a release for more urgent bugs. This seems like a useful improvement for the next iteration.

This message was sent by Atlassian JIRA (v7.10.1#710002-sha1:6efc396)

jpiironen@java.net (JIRA)

unread,
Aug 7, 2018, 5:27:03 AM8/7/18
to jenkinsc...@googlegroups.com

beeofdoom@yahoo.com (JIRA)

unread,
Oct 22, 2018, 6:37:02 PM10/22/18
to jenkinsc...@googlegroups.com
Matt Calderaz commented on Improvement JENKINS-37739
 
Re: Plugin not displaying Robot Test Summary correctly if robot framework task running in parallel in pipeline

Just encountered this issue today in overhauling CI for our RF tests; it's not critical, but a fix would be greatly appreciated.

This message was sent by Atlassian Jira (v7.11.2#711002-sha1:fdc329d)

graines@forcepoint.com (JIRA)

unread,
Oct 24, 2018, 6:16:02 PM10/24/18
to jenkinsc...@googlegroups.com

Our team here would also prefer to display separate Robot Test Summaries, so a fix would be really appreciated.

penven@gmail.com (JIRA)

unread,
Nov 29, 2018, 11:25:02 AM11/29/18
to jenkinsc...@googlegroups.com

I'm facing the same issue on my project. I confirm that a fix would be really appreciated 

Thanks in advance

juho.saarinen+jenkins@gmail.com (JIRA)

unread,
Jan 23, 2019, 6:08:03 AM1/23/19
to jenkinsc...@googlegroups.com

juho.saarinen+jenkins@gmail.com (JIRA)

unread,
Jan 23, 2019, 6:08:05 AM1/23/19
to jenkinsc...@googlegroups.com
Juho Saarinen started work on Improvement JENKINS-37739
 
Change By: Juho Saarinen
Status: Open In Progress

ssingh.alu@gmail.com (JIRA)

unread,
Feb 15, 2019, 12:37:03 AM2/15/19
to jenkinsc...@googlegroups.com

ssingh.alu@gmail.com (JIRA)

unread,
Feb 15, 2019, 12:39:02 AM2/15/19
to jenkinsc...@googlegroups.com
shyam singh commented on Improvement JENKINS-37739
 
Re: Plugin not displaying Robot Test Summary correctly if robot framework task running in parallel in pipeline

We have achieved the same in-house by modifying the same plugin, instead of merging the report, we are showing the merge count and all the report in tabular form,  user can access individual report. Indeed this is very fast, whereas we used to spend lots of time in merging the report . Please refer the attached screen shot.

abhijit_a.sipani@nokia.com (JIRA)

unread,
Dec 30, 2019, 10:47:02 AM12/30/19
to jenkinsc...@googlegroups.com

shyam singh Can you please provide details of how you were able to generate the table?

This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo

staruch.andrej@gmail.com (JIRA)

unread,
Apr 2, 2020, 8:51:04 AM4/2/20
to jenkinsc...@googlegroups.com

Hi, something similar was addressed in the warning-ng plugin https://issues.jenkins-ci.org/browse/JENKINS-54027?attachmentViewMode=list.
Maybe if the id and name parameters would be added, it could solve this issue.

This message was sent by Atlassian Jira (v7.13.12#713012-sha1:6e07c38)
Atlassian logo

staruch.andrej@gmail.com (JIRA)

unread,
May 1, 2020, 8:59:03 AM5/1/20
to jenkinsc...@googlegroups.com
Andrej Staruch stopped work on Improvement JENKINS-37739
 
Change By: Andrej Staruch
Status: In Progress Open
Reply all
Reply to author
Forward
0 new messages