Every application can be updated if you put enough time/money, so not updating is a choice. Conversely, the cost of not updating increases as time passes (what you're experiencing here with development environments that are hard to setup).
If you (or your management) decide to live "in the past", then go all out: use a virtual machine with an OS and all libraries and applications from 13 years ago (GWT 2.2.0 was released in February 2011), and try to preserve snapshots of it to make it easier to setup in case it breaks somehow.
That being said, unless you're trying to debug an application deployed with HTTPS (in which case you'd have to downgrade its security to support such an old Firefox version:
https://wiki.mozilla.org/Security/Server_Side_TLS), there shouldn't be any HTTPS in play, unless maybe to download the devmode plugin. You should be able to download it separately (using another, more recent browser) and then install it in Firefox.