Datastore backup not working, task exits with error code 500

[Daniel Behnen]

Hi,

when trying to create a backup of all my tables, many map reduce tasks (>1,000) are spawn but one task does not complete successfully. The remaining task calls "POST /_ah/datastore_admin/queue/deferred" and exists with error code 500.
Now there are two stalled tasks in the default queue, one for each backup run and the backups do not show up in the backup list.

Is there a way to complete the running backups or to start a successful backup?

Thanks!

[Arie Ozarov]

Hi Daniel,

We can tell more if you give us the application id and a permission to check the related logs and backup metadata.

Arie.

[Daniel Behnen]

Hi Arie,

thanks for your reply. The id is friends4school and please feel free
to check the logs and backup metadata. Thanks in advance!


Daniel

[Arie Ozarov]

Hi Daniel,

In both cases the backup failed in its last stage which is a cleanup stage.

In that stage empty files, that were created by the mapreduce library (for kinds with a small amount of entities), are being removed.

The failure is triggered when there are more than 500 files to be deleted and is going to be addressed soon.

I can either cleanup your failed backups or change them to be marked as complete (leaving the empty files in place).

Also, as a workaround to prevent this kind of failure, until a fixed is available, I suggest you backup 15 kinds or less at a time.

Arie.

[Daniel Behnen]

Hi Arie,

thanks for looking after by backups. Please cleanup the failed backups, I will make new ones containing at most 15 kinds each. Thanks!

Daniel

[Arie Ozarov]

Hi Daniel,

Both backups were removed.

Let me know if you have any more issues.

Regards,

Arie.

--
You received this message because you are subscribed to the Google Groups "Google App Engine" group.

To view this discussion on the web visit https://groups.google.com/d/msg/google-appengine/-/eRlIqghSBWYJ.

To post to this group, send email to google-a...@googlegroups.com.
To unsubscribe from this group, send email to google-appengi...@googlegroups.com.
For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.