Fetch patient data API - how can you pull it continuously, like day by day? date filters?

186 views
Skip to first unread message

Vaibhav Goyal

unread,
Jun 20, 2019, 7:30:12 AM6/20/19
to Developer Group - Beneficiary Claims Data API
I need to build an ETL over this API, would I need to download the whole data file again and again and refresh, or can I pull data based on date time range filters?

Any help appreciated, request examples would be great.   

Liani Lye

unread,
Jun 24, 2019, 4:03:27 PM6/24/19
to Vaibhav Goyal, Developer Group - Beneficiary Claims Data API
Hello Vaibhav!

At this time, we do not have date time range filters -- but we are exploring this option.  If we had such a function, how would you like it to work?

Currently, you would have to pull the entire data file again, and refresh your database tables from that new data file.

All my best,
Liani

-- 

Liani Lye
Community Manager
Beneficiary Claims Data API

Josh Mandel

unread,
Jun 24, 2019, 4:37:01 PM6/24/19
to Liani Lye, Vaibhav Goyal, Developer Group - Beneficiary Claims Data API
If we had such a function, how would you like it to work?

And to tack on one more question: it'd be great if you could also comment on whether _since (as currently documented in bulk data export spec).

--
You received this message because you are subscribed to the Google Groups "Developer Group - Beneficiary Claims Data API" group.
To unsubscribe from this group and stop receiving emails from it, send an email to bc-api+un...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/bc-api/796BDE0D-5DE9-4EB4-A2AD-C4A8D42E0289%40adhocteam.us.

Liz Blair

unread,
Jun 29, 2021, 11:24:45 AM6/29/21
to Beneficiary Claims Data API (BCDA) Community
Hello,

I'd like to follow-up on this thread as we are also interested in the ability to specify a more specific date range rather than just the entire 7 year historical pull all at once. Has BCDA given any additional thought to providing a more specific date range filter, or a way that would allow us to make multiple calls and pull in one year per call (as an example) rather than the entire 7 year history? As it stands right now, the 7 year historical pull can take days to load, we'd like to find ways to reduce the time, but also the potential for failure.

Thanks
Liz

Beneficiary Claims Data API (BCDA) Community

unread,
Sep 1, 2021, 11:23:20 AM9/1/21
to Beneficiary Claims Data API (BCDA) Community

This user received a private message to troubleshoot their question.

For users with a similar question

We recommend users become familiar with requesting historical and incremental data on beneficiaries using the _since parameter with /Group and /Patient endpoints in our documentation. Currently, users can use the _since parameter and /Patient to start a job for data for all beneficiaries since the selected date. With _since and /Group, users can pull filtered data for existing beneficiaries since the selected date and all 7 years of historical data for beneficiaries newly assigned to your organization in the last month.

Because BCDA uses the latest monthly CCLF8 file for attribution, we do not offer a date range specification feature as that might lead to data being pulled on beneficiaries that are no longer assigned to your organization. 

BCDA also offers a "gzip" option to reduce download times: the "Accept-Encoding: gzip" header is optional, but will return a significantly smaller (40X smaller) file with a faster download speed. You will need to uncompress the file after downloading if you supply this header. When downloading multiple files, you can further speed up the process by downloading multiple files concurrently.

Please reach out to us if there are further questions,
The BCDA Team

Reply all
Reply to author
Forward
0 new messages