[JIRA] (JENKINS-60174) To be able to inform test version executed

15 views
Skip to first unread message

sergio.cuenca@grifols.com (JIRA)

unread,
Nov 14, 2019, 9:56:03 AM11/14/19
to jenkinsc...@googlegroups.com
Sergio Cuenca created an issue
 
Jenkins / Improvement JENKINS-60174
To be able to inform test version executed
Issue Type: Improvement Improvement
Assignee: Maria Narcisa Galan
Attachments: Request for change for the plugin 2.docx
Components: hp-application-automation-tools-plugin
Created: 2019-11-14 14:55
Labels: versioning
Priority: Major Major
Reporter: Sergio Cuenca

Request for change for the plugin: Micro Focus Application Automation Tools

Currently the plugin allows to use Junit standard XML files in order to upload test results to ALM. The current XML structure does NOT allow to indicate the test version executed.

We need to be able to indicate the test version executen within the XML file uploaded in ALM.

Let me explain it with an example:

<?xml version='1.0' encoding='UTF-8'?>
<result>
<suites>
   <suite>
     <file>Changes file</file>
     <name>Changes Test Set</name>
     <duration>2.293</duration>
     <cases>
         <case>
           <duration>8.293</duration>
           <className>ChangesManagement</className>
         <testName>List changes</testName>
           <testVersion>4.0</testVersion>
           <skipped>false</skipped>
           <failedSince>0</failedSince>
       </case>
     </cases>
   </suite>
</suites>
<duration>0.576</duration>
</result>

 

The tag testVersion is a non-supported tag, and in this case, the plugin will fail.

In this case, we want to be able to inform the Test Version Number of the instance in the Test Set:

We think that this is a very common situation where typically test cases have different versions and maybe you are execution a version that it’s not the current one, so the plugin should be able to inform the version of the test executed.

 

See attached file.
Add Comment Add Comment
 
This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)
Atlassian logo

li.lu2@hpe.com (JIRA)

unread,
Nov 18, 2019, 9:10:11 PM11/18/19
to jenkinsc...@googlegroups.com
Roy Lu assigned an issue to Roy Lu
Change By: Roy Lu
Assignee: Maria Narcisa Galan Roy Lu

li.lu2@hpe.com (JIRA)

unread,
Nov 19, 2019, 1:50:06 AM11/19/19
to jenkinsc...@googlegroups.com
Roy Lu commented on Improvement JENKINS-60174
 
Re: To be able to inform test version executed

 Hi Sergio Cuenca,

There's no test version concept in ALM. As the test result will be parsed to ALM test set, test and run. What would you like the test version belong to? I mean should it be a field of ALM test set or ALM test or ALM run?

Per my understanding, different versions for Junit test may be different tests for ALM test. Correct me if I'm wrong.

 

BR,

Roy

li.lu2@hpe.com (JIRA)

unread,
Nov 19, 2019, 3:01:07 AM11/19/19
to jenkinsc...@googlegroups.com
Roy Lu edited a comment on Improvement JENKINS-60174
 Hi [~scuenca],


There's no test version concept in ALM. As the test result will be parsed to ALM test set, test and run. What would you like the test version belong to? I mean should it be a field of ALM test set or ALM test or ALM run?

Per my understanding, different versions for Junit test may be different tests for ALM test. Correct me if I'm wrong.

  Or the test version just indicates the version of Junit?

BR,

Roy

li.lu2@hpe.com (JIRA)

unread,
Nov 19, 2019, 3:02:07 AM11/19/19
to jenkinsc...@googlegroups.com

sergio.cuenca@grifols.com (JIRA)

unread,
Nov 19, 2019, 8:11:04 AM11/19/19
to jenkinsc...@googlegroups.com

We use the field “Version Number” of the Test Case which is a OOB field (TS_VC_VERSION_NUMBER). It indicates the version of the test case.
Our scenario is:
1. Let’s imagine we have a test case, called Test X. The test X has 3 versions (it has been modified through the time to modify steps, add more steps, or remove some steps, I don’t care).
2. Then, we have the version 2.0 automated in an external automation tool.
3. We execute the version 2.0 of the test in the external automation tool and we want to load these results in ALM.
4. Currently, when we load the results, the “Version Number” inside the Test Instance, is empty, So we don’t know to which version of the test case this execution corresponds to.
5. So, what we need is to be able to spcify the Version Number inside the XML and load this information. Something like that:

 

XML result

<?xml version='1.0' encoding='UTF-8'?>

<result>

  <suites>

    <suite>

      <file>Changes file</file>

      <name>Changes Test Set</name>

      <duration>2.293</duration>

      <cases>

          <case>

          <duration>8.293</duration>

          <className>ChangesManagement</className>

          <testName>List changes</testName>

           <testVersion>2.0</testVersion>

          <skipped>false</skipped>

          <failedSince>0</failedSince>

        </case>

      </cases>

    </suite>

  </suites>

  <duration>0.576</duration>

</result>

 

 
Add Comment Add Comment
 

li.lu2@hpe.com (JIRA)

unread,
Nov 19, 2019, 9:18:03 PM11/19/19
to jenkinsc...@googlegroups.com
Roy Lu commented on Improvement JENKINS-60174

Hi Sergio Cuenca,

A normal test instance doesn't have  “Version Number”. Is it an user defined field?

li.lu2@hpe.com (JIRA)

unread,
Nov 20, 2019, 1:56:03 AM11/20/19
to jenkinsc...@googlegroups.com
Roy Lu edited a comment on Improvement JENKINS-60174
Hi [~scuenca],

A normal test instance doesn't have  “ Test Version Number” , “Test Version Date”, “Test Version Time” . Is it an Are they user defined field fields ?

sergio.cuenca@grifols.com (JIRA)

unread,
Nov 21, 2019, 12:46:03 AM11/21/19
to jenkinsc...@googlegroups.com
Sergio Cuenca updated an issue
 
Change By: Sergio Cuenca
Attachment: image-2019-11-21-06-45-40-549.png

sergio.cuenca@grifols.com (JIRA)

unread,
Nov 21, 2019, 12:47:02 AM11/21/19
to jenkinsc...@googlegroups.com
Sergio Cuenca updated an issue
Change By: Sergio Cuenca
Attachment: image-2019-11-21-06-46-30-693.png

sergio.cuenca@grifols.com (JIRA)

unread,
Nov 21, 2019, 12:48:04 AM11/21/19
to jenkinsc...@googlegroups.com
Sergio Cuenca updated an issue
Change By: Sergio Cuenca
Attachment: image-2019-11-21-06-47-23-253.png

sergio.cuenca@grifols.com (JIRA)

unread,
Nov 21, 2019, 12:51:03 AM11/21/19
to jenkinsc...@googlegroups.com
Sergio Cuenca commented on Improvement JENKINS-60174
 
Re: To be able to inform test version executed

Hi Roy,

Yes, you are right. Sorry i mean the test case version.
In the instance detail screen you can see the test case versión number:

Which Will be the same that you see in the test case detail screen:

In addition, the run also have a Test Versión Number (as you can see it is a OOB field):

 

What we want to do is to inform the test case versión number inside the RUN that we load from Jenkins.

In a manual execution, the versión displayed in the test instance detail screen corresponds to the test case versión and also the run versión corresponds to the test case versión executed. In regulatory environments, the versioning and the traceability is very important and it is a must for our use case. That's the reason why i am requesting that.

Thanks!
Reply all
Reply to author
Forward
0 new messages