Error File Download Failures - 404 and 429 Errors for 43 ACOs

[Pierce Roberts]

Hi BCDA Team,

We're experiencing issues downloading error files. The problem affects 43 of our ACOs, where data file downloads succeed but error file downloads consistently fail with HTTP 404 and 429 errors.
Details:
  - Scope: 43 ACOs affected; 449 total DB records (448 SUCCESS, 1 PENDING/ERROR)
  - Error types: Primarily 404 (Not Found), with at least one 429 (Too Many Requests)
  - Pattern: Data files download successfully, but error files fail for each affected ACO
  - Retry attempts: We've retried the processes multiple times with the same results
Example errors:
404 error:
  GET https://api.bcda.cms.gov/data/181261/8ec00c0c-350d-4f4e-b125-91408fd11248-error.ndjson -> 404
429 error:
  requests.exceptions.HTTPError: 429 Client Error: Too Many Requests for url:
  https://api.bcda.cms.gov/data/181219/efef4a33-a036-4fb1-a186-2bbf069517db-error.ndjson

Questions:
  1. Is this a known issue? Have other organizations reported similar problems recently?
  2. If this is a temporary issue, what's the expected timeline for resolution?
Workaround:
To unblock our data ingestion pipeline, we're considering skipping these error file downloads. 
Any guidance would be greatly appreciated. Please let me know if you need additional details for troubleshooting.

Thank you,
Pierce Roberts

[Beneficiary Claims Data API (BCDA) Community]

Hi Pierce,

Thank you for reaching out about the 404 responses you've seen when attempting to download error files. In BCDA jobs which produce error files, the error file was not available for download by the client even though the file is listed in the job status.

We've resolved the issue, and moving forward the error files in your next job requests should once again be available. There were no other known service interruptions that happened at the same time, but you may restart your job requests if you are interested in the content of the missing error files.

Please let us know if you see this issue in your future job requests.

Thanks,

The BCDA Team