utf8 bug

[xolo]

hi,

i encountered a problem when serializing utf8 data with Mojo::JSON.
when using JSON::XS everything works fine.

example: <http://pastebin.com/UXQBpUb8>

xolo

[bvn13]

I solve this problem with Mojo::HTML with using:

use encoding 'utf8';

in the header of utf8-encoded source.

Try it.

четверг, 10 мая 2012 г., 11:14:37 UTC+4 пользователь xolo написал:

[xolo]

 

use encoding 'utf8';

in the header of utf8-encoded source.

Try it.

sorry... but this does not work. as far is i understand "use utf8;" does the same.

$self->app->log->info($test1->[0]);

shows the correct output... so it seems to be ok. just Mojo::JSON seems to have a problem.

thanks, anyway!

[Sebastian Riedel]

> just Mojo::JSON seems to have a problem.

Not a bug, templates work with characters and encoded JSON is bytes.

--
Sebastian Riedel
http://twitter.com/kraih
http://mojolicio.us

[xolo]

On Thursday, May 10, 2012 10:30:10 AM UTC+2, sri wrote:

> just Mojo::JSON seems to have a problem.


Not a bug, templates work with characters and encoded JSON is bytes. 

ok, but what do i have to write when i want to embed an utf8 containing json-string in an html template?

changing my example to...

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

use Mojo::ByteStream qw(b);

...

$self->stash( test => b(Mojo::JSON->new->encode($test)));

...

__DATA__

@@test.html.ep

<%= $test %>

~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

does not work neither

xolo :-(

[sri]

ok, but what do i have to write when i want to embed an utf8 containing json-string in an html template?

Just turn the bytes back into characters.

--

sebastian

[xolo]

Just turn the bytes back into characters.

???, i think i'll continue to use JSON::XS. this works fine for me.

thanks anyway... 

xolo

[sri]

???, i think i'll continue to use JSON::XS. this works fine for me.

Perhaps you should take a look at http://perldoc.perl.org/perlunicode.html and http://www.slideshare.net/Penfold/perl-and-unicode.

--

sebastian

[xolo]

On Thursday, May 10, 2012 10:30:10 AM UTC+2, sri wrote:

> just Mojo::JSON seems to have a problem.


Not a bug, templates work with characters and encoded JSON is bytes. 

 rfc4627 says "3.  Encoding: JSON text SHALL be encoded in Unicode.  The default encoding is UTF-8"

so the root of my problem seems to be an implementation detail... JSON::XS uses UTF-8 as default encoding while Mojo::JSON delivers bytes.

xolo

ps: so i could write "decode_utf8(Mojo::JSON->new->encode($test))" or just use JSON::XS which default encoding makes my code shorter (and faster?!). ;-)

[sri]

so the root of my problem seems to be an implementation detail... JSON::XS uses UTF-8 as default encoding while Mojo::JSON delivers bytes.

JSON::XS obviously does not generate UTF-8 but Perl characters, something can't be UTF-8 if it isn't bytes.

--

sebastian