BrowserMob Proxy & LittleProxy

[Patrick Lightbody]

Hi there! I'm the creator of BrowserMob Proxy, a similar-but-slightly-different project. I recently discovered LittleProxy and I really like it! I am starting to think maybe it would be better if I "joined forces" with it and BMP really just was a wrapper around LittleProxy, serving up APIs and data capture (performance HAR files specifically) but leaving the actual proxy work to LittleProxy.

I'd be interested in what others thought of this idea. For background, here are the main capabilities of BMP:

• Supports SSL MITM proxy by using a special CA that needs to be pre-installed in to browsers (Selenium includes it automatically for some browsers)
  
• It's actually a web service that allows you to spin up many HTTP/S proxies, letting you run concurrent Selenium tests, one for each port
• Provides Java API and matching REST web service
• Supports requests/response interceptors but I believe they are more limited than LittleProxy
• REST API for offering up request/response interceptors written in JavaScript (using Rhino to interpret)
• Built on a forked version of Jetty 5, which itself was originally part of Selenium Remote Control and contributed to by Greg Wilkins of Jetty fame
• Supports basic bandwidth simulation, such as latency and upstream/downstream limits
• Supports DNS resolution overrides
• Supports whitelist/blacklist rules (ex: return all Google Analytics tags to be a 0 byte 200 OK)

I think that's most of the capabilities. Anyway, happy holidays!

Patrick

[Adam Fisk]

Definitely sounds like an interesting idea, Patrick! I'm actually particularly curious about your SSL MITM stuff. I wasn't aware Selenium fiddled with that, but it makes sense. Does that work across all browsers? Do you know how exactly? I'm curious because we originally built LittleProxy for Lantern (https://www.getlantern.org), and MITM proxying is particularly useful for getting around some restrictions on traffic we can proxy through App Engine, with App Engine being one of the few things that's consistently unblocked in China (particularly used by GoAgent).

So, a bit of a detour, but I'd love to know more about the above if you happen to know!

-Adam

[Ox Cart]

Very cool!  I'm a fan of Selenium.