json dump file should be opened in binary mode to support ruby 1.9?

[Gokul Janga]

I was trying to index a table from a db that encoding set to 'unicode' and ended up with the following error.

Picky is indexing using a single process: Trake aborted!

"\xCC" from ASCII-8BIT to UTF-8

This might be the result of a problem explained here -

http://stackoverflow.com/questions/4988724/ruby-on-rails-upload-file-problem-odd-utf8-conversion-error

From the answer to that question, it looks ike the json_dump method (see below) in Picky's code 

should open the file in binary mode to resolve this? 

picky/backends/memory/json.rb:

   18          #

   19          def load

   20:           Yajl::Parser.parse ::File.open(cache_path, 'r') # , symbolize_keys: true # TODO Symbols.

   21          end

   22  

   ..

   31          #

   32          def dump_json internal

   33:           ::File.open(cache_path, 'w') do |out_file|

   34              Yajl::Encoder.encode internal, out_file

   35            end

[Picky / Florian Hanke]

Hi Gokul,

Sorry for the late response. I think I got confused since there is also an issue on Github on this.

This might be a good solution to the problem! I'll look into it.

Cheers and thanks,

   Florian