Generating non-Junit reports ...automating the attaching of test execution results / screenshots from a CI system (e.g. Jenkins) to JIRA

[Master Automator]

I understand this maybe more of a Spock question than Geb ... 

tldr;

• I am wondering what other formats of test execution results / reports are easily generated when using Geb/Spock?  In addition to JUnit.

Context:

We are trying to upload test execution results (Junit reports) automatically generated by Geb / Spock into a test case management system. There are some known issues in Junit reports like tags (specifically tags representing the JIRA ticket number the test case is automating etc).  So I am wondering what other formats of test execution results / reports are easily generated when using Geb/Spock?

Also, is anyone here automating the attaching of test execution results / screenshots from a CI system (e.g. Jenkins) to JIRA based test case management systems (like Xray or Zephyr etc)?

Thanks in advance folks!

[Marcin Erdmann]

I would go even further and say that this is not a Spock question but a JUnit question because Spock is using JUnit as the execution engine. I would therefore suggest asking these quesitons in JUnit support channels. Also, contacting Xray and/or Zephyr support might provide some answers.

Cheers,

Marcin

--
You received this message because you are subscribed to the Google Groups "Geb User Mailing List" group.
To unsubscribe from this group and stop receiving emails from it, send an email to geb-user+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/geb-user/1070b5cc-6255-4889-bc27-1ae588490047%40googlegroups.com.

[Master Automator]

Hi Marcin,

You are right about going beyond Spock to JUnit (and actually one step farther to Surefire team)

 

Short summary:

 - As of April 2019, JUnit team is working the Surefire reports team to make to add support for tags etc.

Xray supports Cucumber JSON and their own proprietary Xray JSON to attach evidences (screenshots etc). The tags functionality is in TestNg, Robot etc but not in JUnit.

If you want to post results from Geb Spock's JUnit reports to Xray, you have to write you own converter from JUnit xml reports to Xray JSON and then post the JSON results to Xray API end point using their Jenkins plugin (or in other CI system).

On a tangential but somewhat related note, came across this Best Practices articles from Jenkins contributor : Didn't know there are so many issues with Groovy! https://jenkins.io/doc/book/pipeline/pipeline-best-practices/

Cheers,

Kiran

Here's the link, just scroll to the end of this saga to April 2019: https://github.com/junit-team/junit5/issues/373

On Friday, February 21, 2020 at 1:59:24 AM UTC-8, Marcin Erdmann wrote:

I would go even further and say that this is not a Spock question but a JUnit question because Spock is using JUnit as the execution engine. I would therefore suggest asking these quesitons in JUnit support channels. Also, contacting Xray and/or Zephyr support might provide some answers.

Cheers,

Marcin

On Wed, Feb 19, 2020 at 11:52 PM Master Automator <mastera...@gmail.com> wrote:

I understand this maybe more of a Spock question than Geb ... 

tldr;

• I am wondering what other formats of test execution results / reports are easily generated when using Geb/Spock?  In addition to JUnit.

Context:

We are trying to upload test execution results (Junit reports) automatically generated by Geb / Spock into a test case management system. There are some known issues in Junit reports like tags (specifically tags representing the JIRA ticket number the test case is automating etc).  So I am wondering what other formats of test execution results / reports are easily generated when using Geb/Spock?

Also, is anyone here automating the attaching of test execution results / screenshots from a CI system (e.g. Jenkins) to JIRA based test case management systems (like Xray or Zephyr etc)?

Thanks in advance folks!

--
You received this message because you are subscribed to the Google Groups "Geb User Mailing List" group.

To unsubscribe from this group and stop receiving emails from it, send an email to geb-...@googlegroups.com.