[JIRA] [sauce-ondemand-plugin] (JENKINS-30778) Sauce Labs Test Publisher Configuration

[grulex@gmail.com (JIRA)]

Alex G. created an issue

Jenkins / JENKINS-30778 Sauce Labs Test Publisher Configuration Issue Type: Bug Assignee: Kohsuke Kawaguchi Components: sauce-ondemand-plugin Created: 03/Oct/15 4:00 PM Labels: plugin configuration Priority: Major Reporter: Alex G. I'm using TestNG (also tried JUnit) to run tests in Sauce Labs cloud. In order to update the pass/fail status of those tests in Sauce Labs once they done, I added the "Run Sauce Labs Test Publisher" post-build action to my Jenkins build. First of all, the documentation isn't even clear about how this integration must be configured. This is what it says: "In addition, you will need to output the following line to your for each test that is run using Sauce Labs: SauceOnDemandSessionID=YOUR_SESSION_ID job-name=YOUR_JOB_NAME." What does that mean? To your what? Based on source code, I figured there has to be <system-out> tag in the Surefire XML Report, the content of which must be that line. But that doesn't make much sense, because those tags are only generated when an error happens. Also no matter what I've tried, I just could make Surefire/TestNG output that tag into the report at all. Not even when test failed. I'm either not understanding something (probably) or this way of configuring things is messed up. Last few lines of my log: Starting post-build for Sauce Labs plugin Finished post-build for Sauce Labs plugin Recording test results Starting Sauce Labs test publisher Finished Sauce Labs test publisher Starting Sauce Labs test publisher Finished Sauce Labs test publisher Add Comment

This message was sent by Atlassian JIRA (v6.4.2#64017-sha1:e244265)

[grulex@gmail.com (JIRA)]

Alex G. updated an issue

Jenkins / JENKINS-30778 Sauce Labs Test Publisher Configuration

Change By: Alex G.

I'm using TestNG (also tried JUnit) to run tests in Sauce Labs cloud. In order to update the pass/fail status of those tests in Sauce Labs once they done, I added the "Run Sauce Labs Test Publisher" post-build action to my Jenkins build.

First of all, the documentation isn't even clear about how this integration must be configured. This is what it says: "In addition, you will need to output the following line *{color:red}to your {color}* for each test that is run using Sauce Labs: SauceOnDemandSessionID=YOUR_SESSION_ID job-name=YOUR_JOB_NAME." What does that mean? *To your what?* Based on source code, I figured there has to be <system-out> tag in the Surefire XML Report, the content of which must be that line. But that doesn't make much sense, because those tags are only generated when an error happens. Also no matter what I've tried, I just  could  couldn't  make Surefire/TestNG output that tag into the report at all. Not even when test failed.

I'm either not understanding something (probably) or this way of configuring things is messed up. Last few lines of my log: Starting post-build for Sauce Labs plugin Finished post-build for Sauce Labs plugin Recording test results Starting Sauce Labs test publisher Finished Sauce Labs test publisher Starting Sauce Labs test publisher Finished Sauce Labs test publisher

Add Comment

[sven@styla.com (JIRA)]

Sven Ehlert commented on JENKINS-30778

Re: Sauce Labs Test Publisher Configuration I have the exact same problem. Tests results are not shown on Jenkins. I get the same output on the log as the original reporter

Add Comment

[sven@styla.com (JIRA)]

Sven Ehlert commented on JENKINS-30778

Re: Sauce Labs Test Publisher Configuration

No report printed, but with different testing framworks

Add Comment

[acampbell@saucelabs.com (JIRA)]

Andrew Campbell assigned an issue to Andrew Campbell

Jenkins / JENKINS-30778

Sauce Labs Test Publisher Configuration

Change By: Andrew Campbell Assignee: Kohsuke Kawaguchi Andrew Campbell

Add Comment

[acampbell@saucelabs.com (JIRA)]

Andrew Campbell commented on JENKINS-30778

Re: Sauce Labs Test Publisher Configuration Hi Sven Ehlert y Alex G., regarding this line from the documentation.... First of all, the documentation isn't even clear about how this integration must be configured. This is what it says: "In addition, you will need to output the following line to your for each test that is run using Sauce Labs: SauceOnDemandSessionID=YOUR_SESSION_ID job-name=YOUR_JOB_NAME." What does that mean? To your what? It is confusing and we will work to alter the docs to be more clear in the future. In the meantime I can clarify. In this case, intended destination of the session ID text is the standard output console or Jenkins. However, there could be an easier way to accomplish what you are looking for and a code example can be found here. The SauceOnDemandTestWatcher class should listen for test completion and output the results to console for you. I would advise having a look as I think it could be helpful for both of you. I hope this helps and please do let me know if there are any questions.

Add Comment

[mark.han@willowtreeapps.com (JIRA)]

Mark Han commented on JENKINS-30778

Re: Sauce Labs Test Publisher Configuration

2019 and the same documentation still exists :\ the SauceOnDemandTestWatcher.java class helped.

Add Comment

This message was sent by Atlassian Jira (v7.13.6#713006-sha1:cc4451f)

[danzh@hotmail.com (JIRA)]

dan zhang commented on JENKINS-30778

Re: Sauce Labs Test Publisher Configuration

based on the online doc, you also need this: capabilities.setCapability("build", System.getenv("JOB_NAME")  "__"  System.getenv("BUILD_NUMBER")); {{}} {{}}In my jenkins environment: "BUILD_TAG" is correct.

Add Comment