C-CDA Scorecard

[Frank Spina]

For the past few years the Scorecard grade for our C-CDAs has been “B-“.  This year the Scorecard graded our document with a “D”.  In fact the Scorecard now grades our past C-CDAs with a “D” even though they had previously been “B-".

What has changed with the Scorecard test?

We think those changes may have involved upgrading the standard terminologies (SNOMED, LOINC, RxNORM).  As of this writing we are not aware of any requirement to have updated those terminologies in our system.  Is there a way for us to use an older version of the Scorecard?

[Kim Poletti]

Hi - Thanks for reaching out. This has been logged for review and a member of the team will reach out in the near future.

[Mat Davis]

Hi Frank, have you tried the latest Scorecard UI?

I would rerun your CCD using the new SITE UI 4.0 and see if you get the same results.

https://site.healthit.gov/c-cda/scorecard

Thanks - Mat

[Frank Spina]

Yes, I had tried the new C-CDA Scorecard link and did so again this morning.  Same results as stated previously.

We are approaching the Scorecard issue from a certification standpoint.  Since there is not any certification related problem with our system, (e.g. versioning of standard terminologies) we don’t understand how our C-CDAs are no longer grading as before.

[Mat Davis]

Thanks Frank.

All we can do is wait for more info from ETT/ONC on any changes that may have occurred.

Depending on what you're failing, it's possible the best practices or other rules have been updated. 

I opened an inquiry for more clarity as well.

https://groups.google.com/g/edge-test-tool/c/KEYbTlS0HYU

Thanks - Mat

[Kim Poletti]

Hello Frank,

Can you please attach the file in question for the team to examine?

Thank you,

Kim

[Frank Spina]

Attached.

[Dan Brown]

We are looking into this, but, just to be clear:
-The latest Scorecard did not change any results, only the view. It did add new samples to the Try Me option, though. But, the old ones remain, to show that the backend was not changed. Any change in the grade given for the old SITE 3 high scoring sample would have happened before the SITE 4 update.

-IG and Vocabulary Errors should not alter the score. Those are expected to be resolved before addressing SC issues. Of course, they are provided for convenience, though. There can be vocabulary related issues identified in the rubrics that would alter the results but these are not Errors. The rubrics haven't changed in 4 years or so, and are located here: https://www.hl7.org/implement/standards/product_brief.cfm?product_id=534

If we could get specific, or more specific dates from either of you, as to when the score changed in the results, that would be very helpful. Thanks!

If you want, you can also check the source code, here:

https://github.com/onc-healthit/ccda-scorecard