Comment with non-ascii character doesn't post

[Jonathan Combe]

On Review Board 4.0.11.

I tried to paste in a comment as a reply to a review comment from Outlook. The email contained a smiley symbol.

This did paste into the comment box OK and I hit OK, but I didn't get an error but I also didn't get the green banner asking to publish or discard the comment. If I reefrshed the page the comment is gone.

If I turned on Developer mode I could see it was raising an HTTP 500 Internal Server Error, but this wasn't visible to the user.

Is this a known issue? Is there a fix for it? Otherwise have to manually filter things like this out from emails which is a nuisance.

Thanks

Jon

[Christian Hammond]

Hi Jon,

Most likely, the database being used is MySQL and the tables weren’t created with UTF-8 support. More annoyingly, until recently, MySQL’s UTF-8 support didn’t support Emojis.

To work around the latter, we support Emoji shortcodes. Here’s a list of known ones: 

https://gist.github.com/rxaviers/7360908

But that doesn’t help with copying/pasting.

Other databases (Postgres) and new databases created on MySQL 8+ don’t have this issue. 

Are you the admin on the server? We could check some things.

Christian

--
Supercharge your Review Board with Power Pack: https://www.reviewboard.org/powerpack/
Want us to host Review Board for you? Check out RBCommons: https://rbcommons.com/
Happy user? Let us know! https://www.reviewboard.org/users/
---
You received this message because you are subscribed to the Google Groups "Review Board Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to reviewboard...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/reviewboard/934fcf9f-80cd-4af1-a0ee-adddf4a91baen%40googlegroups.com.

--

--
Christian Hammond
President/CEO of Beanbag
Makers of Review Board

[Jonathan Combe]

Thank you so much for replying Christian.

We were using UTF-8 already, these are the settings in place.

[client]

default-character-set = utf8mb4

 [mysql]

default-character-set = utf8mb4

 

[mysqld]

character-set-client-handshake = FALSE

character-set-server = utf8mb4

default-storage-engine = MyISAM

> Are you the admin on the server? We could check some things.

Unfortunately I am not the administrator, but in contact with the person who is. So can ask for commands to be run or config files to check if it would help.

[Christian Hammond]

Those will impact new tables, but if it’s an older database, you may have older tables that need to be converted.

An admin can use mysqldump --no-data to get a complete schema dump and check the resulting charsets for the tables to see.

There are ways to convert the tables, but I would *highly* recommend testing this process on a copy of the database and then testing Review Board thoroughly against that copy, making sure your data all seems good.

Also, MyISAM is a pretty old table format, and doesn’t have row-level locking or other generally-wanted features, so if work will be done on a major table migration, it might be worth also switching to InnoDB.

Christian

To view this discussion on the web visit https://groups.google.com/d/msgid/reviewboard/96130d2b-b90b-4958-bd64-f09e13a09d69n%40googlegroups.com.