.extract() handling characters with accent e.g. â & ó?

[MPgoog]

I scape the word Teresópolis and it reads "Teres\u00f3polis." How can
I avoid that?

[Pablo Hoffman]

Hi MPgoog,

The scraped data is fine, that's just how Python represents unicode strings.

You can view the readable representation by printing that unicode string in a
Python shell:

>>> print u"Teres\u00f3polis."
Teres�polis.

On Wed, Apr 13, 2011 at 05:08:19PM -0700, MPgoog wrote:
> I scape the word Teres�polis and it reads "Teres\u00f3polis." How can
> I avoid that?
>
> --
> You received this message because you are subscribed to the Google Groups "scrapy-users" group.
> To post to this group, send email to scrapy...@googlegroups.com.
> To unsubscribe from this group, send email to scrapy-users...@googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/scrapy-users?hl=en.

[MPgoog]

Pablo,

Thank you very much. You're right, when printing the value, it is
displaying correctly. Now I will just have to figure out how to get
PHP to echo it correctly :P Or maybe its time to test out Django.

Thanks again,
MP

[Pablo Hoffman]

You can encode it to the string, in the encoding that you use in your PHP
pages. For example, if you use utf-8:

byte_string = u"Teres\u00f3polis.".encode('utf-8')