Transfer data from kobotoolbox to docker

[Sitaram Sawant]

Hello,

We try to transfer data from kobotoolbox to docker, all form that we transfer are working fine but when we create new form in kpi and trying to upload new form data from kobocollect it shows an error(csrf token invalid).

Following Steps that we have done to transfer data

1. Upload forms from kobotoolbox dkobo to docker kpi.

2. Transfer Postgres data in logger_instance from kobotoolbox to docker (according to changes that required now in logger_instance)

3. Transfer MOngo data in formhub from kobotoolbox to docker (according to changes that required now in mongodb)

Is there some thing we are missing while transferring data.

Regards,

Sitaram

[Kurund Jalmi]

Hello,

Just to give more context on this issue: 

1. No error is displayed in the UI. "CRSR token invalid" error is shown in the browser console.

2. In the fresh install of docker instance, form creation is working as expected. So it might be possible that some steps might have been missed in our migration script.

3. Here is the link to migration script: https://github.com/ShelterAssociates/Shelter/blob/master/scripts/pyscript.py

It would be really great if someone can help us in resolving this issue.

Regards,

Kurund

[Esmail Fadae]

Hello. Can you confirm that you've followed the setup procedure described in the `kobo-docker` repo and that the basic functions of your site are working for new forms first?

[Sitaram Sawant]

Hello Esmail,

We have followed all steps of kobo-docker. Everything is working fine, if we do not migrate data. Once we migrate data from old Kobotoolbox instance to new kob-docker using script specified by Kurund above. We start seeing the data to the appropriate survey form and we can even edit using enketo app. The "CSRF token error"  appears only when we create new form or upload data from kobo-collect app. 

if we delete the migrated data everything works fine. 

Regards,

Sitaram Sawant

[Donald Lobo]

Kobo-team:

any chance someone can take a look at this and advise us please. This issue is blocking the rollout on a wider basis

I suspect there is some data being transferred that the code does a check on. Happy to get on the phone/skype to discuss details. We are releasing all the work we do as open source also and will blog about it

thank you for your advice and help

lobo

[Donald Lobo]

this issue has been resolved by the team. We'll send an update in a few hours

lobo

[Vinck, Patrick]

Thanks lobo – please do send the solution / issue.

Support for custom deployment is not as quick as we would like, but we are working on it. We initially thought most use would be through the hosted solutions…

Good luck!

--
You received this message because you are subscribed to the Google Groups "Kobo Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to kobo-users+...@googlegroups.com.
To post to this group, send email to kobo-...@googlegroups.com.
Visit this group at https://groups.google.com/group/kobo-users.
For more options, visit https://groups.google.com/d/optout.

[Kurund Jalmi]

There were 2 issues that we found missing during our upgrade process:

 

1. When we ran the script it created records in logger_instance table of Postgres and MongoDB. But the sequence value was not set correctly for logger_instance id_seq table. It was using old sequence value.

2. There was  a mismatch of version Code and Survey type which is referenced to logger_instance according to kobocat.

After correcting above migrated instances seems to be working as expected.

Here is the updated script that we used for the migration process: https://github.com/ShelterAssociates/Shelter/blob/master/scripts/pyscript.py

Hope it helps.

Kurund

To post to this group, send email to kobo...@googlegroups.com.