Sandbox errors for any regular model entity other than extra-small

[Andy McLaughlin]

Hi BCDA folks!

It seems like this issue raised in 2022 by John K. (or a similar one) has popped up again. When I request data for the small, medium, large, or extra-large sample model entities (/api/v1/Group/all/$export), the export request is accepted, but the result includes OperationOutcome errors like John posted in the linked discussion. The extra-small sample model entity and both of the "Advanced" model entities seem to work fine. The error files themselves are 0 bytes, not sure if that's expected when the job result includes errors in the production environment. Can you advise on whether this is expected behavior? Do these errors mean that I've done something wrong in requesting the job? Are the error files expected to contain information about the errors or are they expected to be blank? 

Example response: 

{'transactionTime': '2023-12-27T07:04:19.32-05:00', 'request': 'https://sandbox.bcda.cms.gov/api/v1/Group/all/$export', 'requiresAccessToken': True, 'output': [{'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/6a1818e9-3711-4443-87b3-9859fc9590f4.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/23e79964-a38e-4ffd-b66e-1af1a9f84bba.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/c99e9b76-9fc5-45c4-aef4-edb30f2354f0.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/887dec21-9b94-4e24-b03b-e71e2fea1050.ndjson'}, {'type': 'Patient', 'url': 'https://sandbox.bcda.cms.gov/data/63305/4eddded3-b659-46ed-90a0-e27d023ee0ef.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/c10fe636-754e-4ac7-b476-b44a94533b54.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/3db731fd-48af-4bf4-bc8b-6398f38f5ba4.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/758b951b-26d0-4d90-bcfd-16d0df1ba1ea.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/e7a23171-160a-4277-a022-a3104172fea2.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/b25f863a-7aaa-4eab-acdb-23b670543efd.ndjson'}, {'type': 'Coverage', 'url': 'https://sandbox.bcda.cms.gov/data/63305/3eb874eb-0b85-4796-933d-e511ea77f83a.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/32acdd3b-2f3d-469a-9564-6de55adc6fea.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/d42d38a9-66cc-4a82-8a83-711cc844a056.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/ba6b5821-8aff-46fc-8999-7a34a9aa4c93.ndjson'}, {'type': 'ExplanationOfBenefit', 'url': 'https://sandbox.bcda.cms.gov/data/63305/5af8f17a-5ee5-43e0-9111-665ab2334a6c.ndjson'}], 'error': [{'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/6a1818e9-3711-4443-87b3-9859fc9590f4-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/23e79964-a38e-4ffd-b66e-1af1a9f84bba-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/c99e9b76-9fc5-45c4-aef4-edb30f2354f0-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/887dec21-9b94-4e24-b03b-e71e2fea1050-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/4eddded3-b659-46ed-90a0-e27d023ee0ef-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/c10fe636-754e-4ac7-b476-b44a94533b54-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/3db731fd-48af-4bf4-bc8b-6398f38f5ba4-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/758b951b-26d0-4d90-bcfd-16d0df1ba1ea-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/e7a23171-160a-4277-a022-a3104172fea2-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/b25f863a-7aaa-4eab-acdb-23b670543efd-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/3eb874eb-0b85-4796-933d-e511ea77f83a-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/32acdd3b-2f3d-469a-9564-6de55adc6fea-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/d42d38a9-66cc-4a82-8a83-711cc844a056-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/ba6b5821-8aff-46fc-8999-7a34a9aa4c93-error.ndjson'}, {'type': 'OperationOutcome', 'url': 'https://sandbox.bcda.cms.gov/data/63305/5af8f17a-5ee5-43e0-9111-665ab2334a6c-error.ndjson'}], 'JobID': 63305}

[Beneficiary Claims Data API (BCDA) Community]

Hi Andy,

We're sorry to hear about your problems accessing some of the sandbox datasets. We're looking at the logs to see if they have any useful information. Then we will try to reproduce the error. We'll get back to you when we have more information.

Thanks,
The BCDA Team

[Andy McLaughlin]

I'm also seeing similar behavior in production, where zero-byte error files are included in the response when the job completes. See job # 59540 for an example. It's possible that since these error files have no actual data in them, I should just ignore them. It would be great to get confirmation of that though, or if they could be omitted from the response if there were no actual errors that the client needs to be aware of.

[Beneficiary Claims Data API (BCDA) Community]

Hi Andy,

This seems to be related to the bug that caused empty error files, fixed in r216. That said, the larger BCDA sandbox datasets DO include some errors, so it's normal to get some error responses. This is to test that clients are able to handle errors. You're not doing anything wrong, but we acknowledge that this might be confusing when learning about the API.

Hope this helps,

The BCDA Team