Use Java Concurrency with Selenium and Browsermob-Proxy

[David Jung]

Hi there,

currently I am facing a strange problem when starting several Selenium WebBrowsers with different proxies concurrently. You can find the implementation in the end.

The main problem is the long loading time:

Let's assume I start 5 tasks concurrently. Each task opens a Selenium WebBrowser with its unique proxy. 2 of 5 tasks are working well and the others have loading times over 1 min. Even if only 1 task is left, this one is loading extremly slow. It's not a hardware problem. The proxies are datacenter proxies with a fast response time and enough bandwidth. 

The following code is the one I use for each WebDriver but with a unique proxy.

Hopefully someone has an idea!

Thanks in advance,

David

BrowserMobProxyServer browserMobProxy = new BrowserMobProxyServer();

browserMobProxy.setChainedProxy(new InetSocketAddress(ip, port));

browserMobProxy.chainedProxyAuthorization(username, password, AuthType.BASIC);

browserMobProxy.setTrustAllServers(true);

browserMobProxy.start(0);

    

chromeOptions.setProxy(ClientUtil.createSeleniumProxy(browserMobProxy));

WebDriver driver = new ChromeDriver(chromeOptions);