Backfill jobs stuck for 3 ACOs

[Paul Miller]

We are attempting to run backfills (no `_since` parameter) of ExplainationOfBenefit data for all of our ACOs, and 55 of our 58 have completed with the exception of three, which have been stuck at 0% for about 16 hours for this attempt.

I have over the past week or so attempted them multiple times, and cancelled the jobs after about 24 hours at 0%. I will leave them running until told to do otherwise, but they definitely feel like they're stuck and any assistance would be appreciated. Thanks!

ACO - Job number

A4776 - 92186

A5216 - 92187

A5358 - 92188

[Beneficiary Claims Data API (BCDA) Community]

Hi Paul,

Sorry for the delays in processing the job requests for these three ACOs. We see that 2 of the job requests have completed at this point and the third has progressed past 90%.

We suspect these requests were delayed because of how BCDA prioritizes job requests, rather than a degradation of the service. Our team is reviewing how job priority is determined. We'll let you know if there are any findings to share or changes that result from the investigation.

Thanks for reaching out and let us know if you have any questions.
The BCDA Team

[Paul Miller]

Good afternoon! I was able to get all ACOs backfilled with the exception of one: A4776

I triggered a new backfill job yesterday and it is still reporting as 0% complete. Can I get someone to look and see what's going on with that ACO? I had the same issue multiple times two weeks ago when I initially tried loading the backfills.

[Paul Miller]

Update: The job finally completed and I was able to download the files.

[Beneficiary Claims Data API (BCDA) Community]

Hi Paul,

Thanks for confirming the job has completed and we apologize for the delays for several of your recent backfill requests. We're working to improve the time-to-complete job requests without the _since parameter and patch the bug causing the job status to always report "In-Progress: 0%". You can follow this thread to stay up-to-date on those two issues.

Thank you,
The BCDA Team