Nightwatch Tests Timing Out on CircleCI

[Derrick Schmidt]

Hello,

We have been using Nightwatch and CircleCI for quite some time. Lately we have been seeing Time Outs, the test that is timing out is random so I believe it isn't something that we are doing in our tests, it appears that the browser isn't even opening on CircleCI and it does not hit the beforeEach.

Verbose Log:

Running:  Test-Test1
INFO Request: POST /wd/hub/session 
 - data:  {"desiredCapabilities":{"browserName":"chrome","javascriptEnabled":true,"acceptSslCerts":true,"platform":"ANY","chromeOptions":{"args":["--user-agent=Mozilla/5.0 (iPhone; CPU iPhone OS 7_0_2 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A4449d Safari/9537.53","--window-size=320,640","--allow-running-insecure-content","--test-type"]},"name":"Mobile / Workflows / Registered Checkout"}} 

- headers: {"Content-Type":"application/json; charset=utf-8","Content-Length":417} command grunt nightwatch -e mobile --tag conversion --retries 1 --verbose took more than 1800 seconds since last output

Has anyone else run into something similar?

Nightwatch: 0.8.6

Selenuim: 2.48.2

chromeDriver 2.20

[Andrei Rusu]

Did you also check with CircleCI support?

> --
> You received this message because you are subscribed to the Google Groups
> "NightwatchJs" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to nightwatchjs...@googlegroups.com.
> To post to this group, send email to nightw...@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/nightwatchjs/30e44bdd-00f1-4571-83f5-34bde52fa259%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

[Derrick Schmidt]

Yup. First thing I did. It looks like on average 1 in 10 test runs it occurs

Sent from mobile

.

-- 
You received this message because you are subscribed to a topic in the Google Groups "NightwatchJs" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/nightwatchjs/MdmI1D8LkPY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to nightwatchjs...@googlegroups.com.
To post to this group, send email to nightw...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nightwatchjs/CALPNQ21NGNa8F_Zv-X7G3b9mYx7roThGcN19H_K_%3DmH6OK6e6Q%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[AdamWardecki]

I'm having similar issues. 

Nightwatch: 0.8.6 (same issues with 0.7.11)

Selenium: 2.48.2 (same issues with previous versions)

Chrome: 2.20 (same issues with previous versions)

Node: 4.2.2 (npm: 2.14.7)

[Andrei Rusu]

So what did CircleCI say? I'm not sure if there's nothing to be done
in Nightwatch. Maybe try increasing the timeouts?

> --
> You received this message because you are subscribed to the Google Groups
> "NightwatchJs" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to nightwatchjs...@googlegroups.com.
> To post to this group, send email to nightw...@googlegroups.com.
> To view this discussion on the web visit

> https://groups.google.com/d/msgid/nightwatchjs/37240db9-851c-41c7-a1c0-5fa592b60659%40googlegroups.com.

[Derrick Schmidt]

That was their suggestion. The problem is at some point at the beginning of a new test selenium will make a request and not receive a response from the browser. The test does not even reach the before step. So setting the timeout doesn't matter, I have tried 1min to 18mins

Sent from mobile

.

-- 
You received this message because you are subscribed to a topic in the Google Groups "NightwatchJs" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/nightwatchjs/MdmI1D8LkPY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to nightwatchjs...@googlegroups.com.
To post to this group, send email to nightw...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nightwatchjs/CALPNQ2288iTLA%2BFWohW-EO5fMOMpvQdCWEh2%3DcRUxhZsho37ng%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.

[Andrei Rusu]

So then the issue is between selenium and the browser?

> https://groups.google.com/d/msgid/nightwatchjs/DAAB2D488DB22D6C.6077FCC6-44B2-4E78-B857-58FE9CE7D038%40mail.outlook.com.

[Derrick Schmidt]

This is the verbose output from CircleCI

Running:  Checkout - Signed In - Step 1 Billing & Delivery - Verify Elements Present

INFO Request: POST /wd/hub/session 
 - data:  {"desiredCapabilities":{"browserName":"chrome","javascriptEnabled":true,"acceptSslCerts":true,"platform":"ANY","chromeOptions":{"args":["--user-agent=Mozilla/5.0 (iPhone; CPU iPhone OS 7_0_2 like Mac OS X) AppleWebKit/537.51.1 (KHTML, like Gecko) Version/7.0 Mobile/11A4449d Safari/9537.53","--window-size=320,640","--allow-running-insecure-content","--test-type"]},"name":"Mobile / Workflows / Registered Checkout"}} 

- headers: {"Content-Type":"application/json; charset=utf-8","Content-Length":417} command grunt nightwatch -e mobile --tag conversion --retries 1 --verbose took more than 1800 seconds since last output

Derrick Schmidt, Lead Quality Assurance Engineer

Better Mobile Shopping.

mobify.com | D 866.502.5880 | M 604.240.9130 |

Get deep insights into mobile shopping strategy on Mobify Insights.

To view this discussion on the web visit https://groups.google.com/d/msgid/nightwatchjs/CALPNQ23PS9c9Pn-Vsh5DKfnRGVGHJkoN_PQ2djAN0qS5BdOveg%40mail.gmail.com.

[Tim Minkov]

I'm having the same issue, unfortunately.

[AdamWardecki]

I'm still experiencing this issue too. The tests time out during the execution of before() hooks and not the test steps.

Node: v6.2.1 (npm v3.9.3)
Nightwatch: 0.9.4
Selenium: 2.53
Chrome: 2.16

[Diego Prado]

Guys, The problem here is that nighwatch hangs when selenium fails to create a new session. a few issues have been created in nightwatch github and there is already a PR to fix this.
https://github.com/nightwatchjs/nightwatch/pull/1232