SSL error: handshake failed blocking script
pnetwo...@gmail.com
I am running Chrome 53, ChromeDriver 2.24, Python 3.4, and Selenium 2.53.5.
I am using the above to scrape some data (I know there are easier ways, I am trying to learn about Selenium too). My code was running fine until a few days ago when (I think) the website I am scraping from introduced some new ad-related scripts. These scripts load from http, the site I am scraping is https, resulting in mixed content errors and (I think) the following error code in my terminal:
[19852:2032:0912/202419:ERROR:ssl_client_socket_impl.cc(1141)] handshake failed;
returned -1, SSL error code 1, net_error -100
[19852:2032:0912/202419:ERROR:ssl_client_socket_impl.cc(1141)] handshake failed;
returned -1, SSL error code 1, net_error -100
In itself, this is fine/useful information and (most of the time) no problems occur. However, when the browser tries to load certain scripts, the error starts to loop and (eventually) blocks the rest of my script.
If I open developer tools in Chrome, the same sort of behaviour is evident. The console shows a few warnings and errors sometimes (mainly insecure images) and the script manages to keep going. When the warnings and errors starts looping (usually referencing a plugin), then everything comes to a halt.
Unfortunately, and I am not sure if this is connected, I have been unable to replicate these errors when browsing normally in Chrome.
I have tried command-line arguments and fiddling with the browser settings whilst the script is running...all to no avail.
I am not sure what the solution is here...or even exactly what the problem is...do I just need to surpress the errors? Is there something specific to ChromeDriver going wrong? Do I just need to block certain scripts from loading? Any help/insight into why the errors are triggering the way they are would be great :)
