Feasibility of using WebTest for screen scraping

[Randy Syring]

I have a job I need to do that requires some screen scraping of large
forms, modifying just a couple values, and then posting the whole form
back. I have used WebTest in the past for local testing and this is
almost exactly what I need. Load the URL, modify two or three form
fields, and post back.

I was thinking I could create a WSGI application that actually made
the changes on the server and then use the "test" features in WebTest
to actually do the work. So web test would be interacting with a WSGI
application that was getting/posting information to the actual
server.

So, any suggestions on how I might use WebTest in this scenario?
Maybe a better idea?

Thanks.