Encoding and cp1252

[Matt]

Hi there,

I'm using web2py on GAE and have recently run into some problems with cp1252 characters being submitted via cut and posted text in forms.

At present whenever this happens I get exceptions complaining that the string isn't valid unicode.

Looking through the web2py codebase I can see that some contrib code (like feedburner.py for example) is checking and replacing offending cp1252 characters.

I know I can potentially use the onvalidation method on my forms to perform something similar to feedburner however I would prefer that I can control this on a "global" form level.

Does anyone have any suggestions on how I might be able to achieve this? or is it best to raise this as a feature request / bug?

Thanks in advance,

Matt

More info: http://effbot.org/zone/unicode-gremlins.htm