Consolidated Test case reports of selected successful Jenkins jobs

[Lakshmi narayana]

Dear All,

 

My requirement is here.

Scenario: 10 Jobs with each job having 5 Testscases each Pass Rate (PR) In 1 week if each job will be triggered once daily, each one will have run 25 Testscases (5 Testscases /job x 5  days) So, 10 Jobs x 25 Testscases /job = 250 Tests triggered in 1 week Pass Rate (PR) = Total # of Passed/Total  # of Testscases  example: 235/250 (94%) Note that, we are reporting Tests not Builds! Average Run Time (ART) This refers to the average time required to run the full test suite. RTx = Average run time of each job [where x: 1,2,3,..10] computed as run time on each day divided by number of days [ (T1+T2+T3+T4+T5)/5 ] ART = RT1 + RT2 + RT3 + ... + RT10 Total number of Tests triggered Total number of unique tests run. In this example, this will be 10 Jobs x 5 Tests/Job so 50 unique tests. Trend Pass Rate To monitor the state of our test scripts on a weekly basis. Mainly for stability or early detection of issues. Average Run Time To monitor if we can support the under 12 hours regression Test Suite Size (Total number of Tests triggered) To monitor if we are adding more tests to the automation suite

 

Could you please show me the light – how to achieve this target ?

Thanks in Advance.

 

 

Regards,

LnT

[Ted Xiao]

Declaimer: I work for Splunk and those options represent my own and not those of my employer.

You can archive the goal but REQUIRE additional software.

https://splunkbase.splunk.com/app/3332/

https://wiki.jenkins-ci.org/display/JENKINS/Splunk+Plugin+for+Jenkins

You can obtain a free license with 500MB/day limit from www.splunk.com

https://www.splunk.com/en_us/products/splunk-enterprise/free-vs-enterprise.html

[Lakshmi narayana]

Thanks so much Ted.i will check the said Link

--
You received this message because you are subscribed to a topic in the Google Groups "Jenkins Users" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/jenkinsci-users/jDqEaldUl7c/unsubscribe.
To unsubscribe from this group and all its topics, send an email to jenkinsci-users+unsubscribe@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/jenkinsci-users/70e596ba-6d4a-484f-9abc-e2d5f4d7720a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Lakshmi narayana]

Hi Ted,

 

Thanks to your reply.

 

Few questions. Hope you never mind J

 

1.       Apart from Splunk , does any additional software’s needed to achieve the target ?

a.       As Regression test suits having different reports generated by jenkins jobs

                                                               i.      TestNG Report

                                                             ii.      Extent Report

                                                            iii.      Robotic Frame work reports

2.       Does the Splunk free license expire after 60days .If yes , shall I re-install and re-configure ?

 

Thanks in advance

 

Regards,

LnT

=================================================================