BigQuery Transfer Job of Firebase Crashlytics pending for a long time before start

105 views
Skip to first unread message

Po Jian

unread,
Sep 11, 2023, 1:17:32 AM9/11/23
to Firebase Google Group
We are currently working on exporting Firebase Crashlytics data to BigQuery. However, there is consistently a waiting period preceding each transfer task, which typically spans from around 10 to 20 hours. The accompanying log message reads, "Files not ready to be processed yet." the logs like:
2023-09-09 18:59:00.440 HKT
Dispatched run to data source with id 8582819258198237

2023-09-09 18:59:00.707 HKT
Files not ready to be processed yet.

2023-09-10 13:33:11.995 HKT
Job 1007303307943:crashlytics_batch_data_source_6506bfe6-0000-OOOXXXXX (table com_OOOOXXXX_IOS) started.
....

the task is scheduled at 2023-09-09 18:59:00,
But eventually started at 2023-09-10 13:33:11,
after 17 hours later. This delay occurs consistently with each daily task, but the duration of the delay varies, falling within the 10 to 20-hour range as previously mentioned. We would greatly appreciate it if someone could provide an explanation for this situation or offer any advice on how to mitigate it. Additionally, we welcome any reference documents that may shed light on this issue.

Reply all
Reply to author
Forward
0 new messages