Jenkins cucumber reports plugin for comparison of previous reports

1,079 views
Skip to first unread message

Ronk30

unread,
Jul 17, 2015, 5:45:08 PM7/17/15
to cu...@googlegroups.com
Hi All,

I have Jenkins job that runs everyday and runs my automation tests written using Cucumber. I am using the Cucumber-jvm plugin to generate cucumber reports everyday. I really like the detailed reports for each build that it generates.

However, I wanted to check if anyone knows of a plug-in or a way to compare the reports from previous builds at one place ? Basically I want to see which scenarios/step definitions have a history of taking a long time to run without going to each report manually and then keeping a track of the time taken in each build for them. 

Rohan

Damian Szczepanik

unread,
Jul 20, 2015, 3:23:10 PM7/20/15
to Ronk30
You can use https://github.com/masterthought/cucumber-reporting that does not show history on single page but you can easily switch to previous build and see details of the same tag/feature. So if you find regression you can click 'Previous build' to see if this is new regression. If not you can click 'Previious build' again and again until you find the test passed. This gives you the exact build that detected the regression.

Damian

James Nord

unread,
Aug 4, 2015, 5:59:37 PM8/4/15
to Cukes
a google for "jenkins cucumber" takes me #1 to https://wiki.jenkins-ci.org/display/JENKINS/Cucumber+Test+Result+Plugin

Why did you write a new cucumber reporter?

There where limitations in the way that the existing support for Cucumber was handled that was suboptimal.

There is nothing wrong with the cucumber jvm reports plugin and they can be used in tandem - however that plugin doesn't offer the normal jenkins testresult interfaces. Namely there is no trend reports or test history. There is also no API that you can integrate with.

Likewise you could output junit xml style reports from cucumber - but this also has limitations. Namely the output is less than stellar, you have no view of tags or the nice goodness that the previous mentioned plugin provides.

This plugin solves both of these issues so you only need one place to look.

 
 
Reply all
Reply to author
Forward
0 new messages