how to force search-index rebuild to index with errors?

[Marcelo Martinez]

Hi!

We generated a db dump and replaced a ckan instance db with other, no problems here.

But following the steps required we updates the solr indexes and get an error:

 ckan -c /etc/ckan/default/ckan.ini search-index rebuild
2023-01-03 12:19:19,603 INFO  [ckan.cli] Using configuration file /etc/ckan/default/ckan.ini
2023-01-03 12:19:19,603 INFO  [ckan.config.environment] Loading static files from public
2023-01-03 12:19:19,854 INFO  [ckan.config.environment] Loading templates from /usr/lib/ckan/default/src/ckan/ckan/templates
2023-01-03 12:19:23,769 INFO  [ckan.config.environment] Loading templates from /usr/lib/ckan/default/src/ckan/ckan/templates
2023-01-03 12:19:26,806 INFO  [ckan.lib.search] Rebuilding search index...
2023-01-03 12:19:26,907 INFO  [ckan.lib.search] Rebuilding the whole index...
Indexing dataset 3666/44522023-01-03 12:29:35,431 ERROR [ckan.lib.search] Error while indexing dataset u202cdefault', 112, 113, 'ordinal not in range(256)')
'latin-1' codec can't encode character '\u202c' in position 112: ordinal not in range(256)
2023-01-03 12:29:40,585 INFO  [ckan.lib.search] Commited pending changes on the search index

Is there a way to force indexing process with errors?

Thanks!

 

[José Joaquín Escobar Gómez]

Have you restarted the solr proccess before the reindexing?

[Marcelo Martinez]

Hi!

Thanks!

Yes we restarted tomcat and ran the search-index rebuild but the problem persists.

[Marcelo Martinez]

The indexing fails because in the database we have a record with a special character. Can we configure the indexing to ignore that error?

Thanks!