Local implementation of ReferenceCCDAService (CCDA Validator)

[Parag Dadhania]

Hello All,

We have downloaded latest version .war file (1.0.23) of referenceccdaservice from https://github.com/siteadmin/reference-ccda-validator/releases and published webapp under Tomcat 8.5. We are able to use UI as well as service call from our code and receiving validation report. However, validation report appears to be providing following items only:

- C-CDA MDHT Conformance Error

- C-CDA MDHT Conformance Warning

- C-CDA MDHT Conformance Info

- ONC 2015 S&CC Vocabulary Validation Conformance Info

Received XML CCDA does contain Vocabulary Errors but they are not included in the validation report so following two type are reporting 0 items:

- ONC 2015 S&CC Vocabulary Validation Conformance Error

- ONC 2015 S&CC Vocabulary Validation Conformance Warning

Same XML CCDA is tested against NIST hosted Validator (https://ttpds.sitenv.org:8443/referenceccdaservice/swagger-ui.html) will produce a report indicating Vocabulary Error for language.

We have placed all vocabulary files in xlsx format as downloaded from https://vsac.nlm.nih.gov/valueset/expansions. Some vocabulary files for such as Language were downloaded from https://github.com/siteadmin/code-validator-api/tree/master/codevalidator-api/docs/ValueSetsHandCreatedbySITE

All vocabulary files are placed under C:\Base_Path\vocabulary\valueset_repository\VSAC folder. Upon review of log file from tomcat, we are seeing below entries

INFO  [VocabularyLoadRunner:92] Loading vocabularies at: C:\Base_Path\vocabulary\code_repository\...

INFO  [VocabularyLoadRunner:94] Vocabularies loaded...

INFO  [VocabularyLoadRunner:99] Loading value sets at: C:\Base_Path\vocabulary\valueset_repository\VSAC\...

INFO  [VocabularyLoadRunner:101] Value Sets loaded...

INFO  [VocabularyLoadRunner:105] !!!!*********** VOCABULARY DATABASE HAS FINISHED LOADING - SERVER WILL CONTINUE AND SHOULD BE DONE SHORTLY. ***********!!!!

Above listed entries are leading us to believe that xlsx files placed under VSAC folder is not being loaded correctly. As indicated earlier, all xlsx files are downloaded from VSAC and placed under folder as is without any modification. Can someone please guide us in right direction as to if there is any modification required for these vocabulary files in xlsx format?

When we are making a post call using swagger ui, we are seeing following log entries in Tomcat:

INFO  [ReferenceCCDAValidationService:164] Attempting MDHT validation...

WARN  [ReferenceCCDAValidator:249] An invalid validationObjective was POSTed

INFO  [ReferenceCCDAValidator:130] Mapped mdhtValidationObjective: NonSpecificCCDAR2

INFO  [ReferenceCCDAValidator:141] Loading mdhtValidationObjective: NonSpecificCCDAR2 mapped from valdationObjective: C-CDA_IG_Plus_Vocab

INFO  [ReferenceCCDAValidator:100] Processing and returning MDHT validation results

INFO  [ReferenceCCDAValidationService:104] Adding MDHT results

INFO  [ReferenceCCDAValidationService:169] Attempting Vocabulary validation...

INFO  [ReferenceCCDAValidationService:113] Adding Vocabulary results

INFO  [ReferenceCCDAValidationService:124] Skipping Content validation due to: validationObjective (CCDA_IG_Plus_Vocab) is not relevant or valid for Content validation

We would greatly appreciate any help to get our local implementation of CCDA Validator working in same manner as NIST hosted.

[Jason Countryman]

Take the 'VSAC' off the end of the appropriate line in referenceccdaservice.xml.  The validator will look in the VSAC folder itself.

[Parag Dadhania]

Hi Jason,

Removed 'VSAC' from the path within referenceccdaservice.xml and that made it work as expected. Thank you very much for your quick response.

Also, we have noticed that VocabularyLoadRunner is having difficulty processing .xls file. However, when we re-saved same file as .xlsx then it seems to be working fine. We will post any other issues found but for now it seems to be working fine.

Thank you,

Parag.

[Walter Rey]

Hi guys, can you provide me with any insight on my issues below?

I am having issues setting up the C-CDA validator in-house and I can't figure out what I am doing wrong.

I deployed everything provided with the build following all the instructions that come with it but all I get when I start Tomcat is the .War file deployed.  

The site seems to be online but I never see the database scripts get run and when I try to access the URL I get a 

HTTP Status 404 - /referenceccdaservice/

Also, adding /ui at the end as mentioned in the documentation returns the same 404 error.

I have tried in two separate servers and with Tomcat 7 and Tomcat 8. Both are giving me the same result so I am sure I am missing something somewhere.

I am not very experienced with Tomcat so I am also not sure where I am supposed to put the reference-ccda-validator-1.0.25 site I downloaded from the Github repository. 

I placed it in the Tomcat WebApps folder and referenced the location of the scenarios and vocabulary repository folders in the XML as per the documentation but still I don't see anything accessing it.

Please let me know ASAP.

Thanks.

[Brian Harris]

Hi Walter,

Does the Tomcat container show any errors while it is starting up or does it seem as if Tomcat starts correctly?

[Walter Rey]

Hi Brian, thanks for replying.

Tomcat it self does not show any errors in the console or the logs.

The default sites that come with it are working fine, the only thing not working properly for me is the referenceccdaservice site.

It shows all sites including referenceccdaservice as online and no issues with it on the Tomcat App Manager.

The .War file got deployed after starting Tomcat and I see 143 files in that folder but somehow I cannot browse it.

I have restarted Tomcat several times and even removed the .War file so it would not try to redeploy it every time.

Any other ideas?

[omer khan]

hello,

i also face the same problem and but i did not produce the "ONC 2015 S&CC Vocabulary Validation Conformance Error" it is always zero.

i have place all the value set files at : 

C:\blazeds\tomcat\webapps\path\to\validator_configuration\vocabulary\valueset_repository\VSAC

attached are my config files. 

can you please tell me what i sent in validation objective.

Thanks

Omer

[James Threatte]

I have a local installation of the CCDA Reference Validator and Im trying to do the B1 Negative Test cases. CCD 2.1 Sample 4 has Vocabulary Validation errors according to the test docs. My validator only finds the MDHT Conformance errors. I installed the latest release Validator 1.0.34 hoping the change in valueset and codeset requirements would fix the problem but Im still not seeing Vocab errors. 

A different thread mentions Schema errors will skip vocab validations but the official ETT correctly finds the MDHT conformance errors AND the vocabulary errors. Our test date is coming up and we've spent a lot of time trying to figure this out. HELP!  

[Nagesh Bashyam - Drajer]

Hello

Have you installed the required vocabularies (ValueSets and CodeSystems) ? 

Without them the vocabulary errors will not show up ? 

If so, can you send us your snippets of you ReferenceCCDA log file or tomcat log file…which shows the service starting up.

Thanks

Dragon

--
You received this message because you are subscribed to the Google Groups "Edge Test Tool (ETT)" group.
To unsubscribe from this group and stop receiving emails from it, send an email to edge-test-too...@googlegroups.com.
To post to this group, send email to edge-te...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/edge-test-tool/86afc7b9-087e-4244-abe8-27e6ad97b01f%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.

[Sumanth Bandaru]

Hello,

Can you tell me which vocabularies needs to be used exactly? I followed https://github.com/siteadmin/code-validator-api/tree/master/codevalidator-api/docs . I can see 100 valuesets in value_set_list_with_code_count.xlsx from VSAC site needs to be downloaded. Do I have to download 100 valuesets individually and place them in vocabulary folder?

[James Threatte]

Hello

I installed all 98 of the valuesets specified in the Instructions 7-26-18 document. I also added the 4 valuesets made by SITE. 

I installed most, but not all of the codesets. The ones I am missing are CDT, CPT, and HCPCS. 

If some of the codesets are missing would vocab validation completely fail? The MDHT conformance errors works ok. 

I attached the referenceccdaservice.xml config file and a log file from performance of the validation.

On Tuesday, September 4, 2018 at 6:27:52 AM UTC-5, nagesh.bashyam (Dragon) wrote:

[Dan Brown]

Hi James,

In this path on your computer or server (not in the config file):

"/var/local/ccda-validator-configuration/vocabulary/valueset_repository"

Is there a 'VSAC' folder within the valueset_repository or are the spreadsheets directly in the valueset_repository folder?

If there is not a VSAC folder, please add it and move the sets there. Leave the config the same. Let me know if that resolves your issue.

"If some of the codesets are missing would vocab validation completely fail?"

It should work with the data it is given and fire results as long as the file sent is relevant to the vocabulary downloaded.

What errors are you expecting? Can you post them here (the ones you get in SITE)?

Thanks,

Dan

[James Threatte]

Dan, thanks for your help.

This fixed it.

Put the valueset repository files in a subfolder called VSAC 

/var/local/ccda-validator-configuration/vocabulary/valueset_repository/VSAC

The referenceccdaservice.xml config file should omit the /VSAC

/var/local/ccda-validator-configuration/vocabulary/valueset_repository

We saw this in previous posts but didn't understand it. 

We suggest the instructions be updated to include this detail.

Thanks again

[Dan Brown]

Great. Np.

I updated the reference validator readme on the develop branch to be more clear about the VSAC folder. This will be merged to master in the next release.

[Dan Brown]

You can use as little or as many sets as you want. That is up to you. If you want to match SITE then you must use every set in the spreadsheet noted. Yes, you need to place them in a VSAC folder within your configured local path. 4 of the sets are available to download in the code validator which are not available in the VSAC website.

Thanks,

Dan

[Richard Braman]

Dan,  I am wondering if the cs_versions_c_cda_20190628.xlsx file from UMLS can be used with the same results?  Or do we need to download all individually?

[Dan Brown]

I'm not sure what the formatting of that file is but I'm guessing it will not match VSAC. Anything which does not match the VSAC format requires a specific loader to be written and to my knowledge we have not written a loader for the file listed.

[Richard Braman]

Thanks Dan,  We will download the files individually from VSAC.  One other question:

Where do we find these code_repository files?  Do we need to go to each source, find,  and download the files?

 -- code_respository
    |-- CDT
        |-- c_CDT2016ExcelMasterForASCII_revised2015May12_DBCQ.xlsx
    |-- CPT
        |-- LONGULT.txt
        |-- MEDU.txt
        |-- SHORTU.txt
    |-- HCPCS
        |-- HCPC2018_CONTR_ANWEB.txt
    |-- ICD9CM_DX
        |-- CMS32_DESC_LONG_SHORT_DX.txt
    |-- ICD9CM_SG
        |-- CMS32_DESC_LONG_SHORT_SG.txt
    |-- ICD10CM
        |-- icd10cm_order_2017.txt
    |-- ICD10PCS
        |-- icd10pcs_order_2017.txt
    |-- LOINC
        |-- loinc.csv
    |-- RXNORM
        |-- RXNCONSO.RRF
    |-- SNOMED-CT
        |-- sct2_Description_Snapshot-en_US1000124_20170901.txt

[Nagesh Bashyam - Drajer]

Yes

You will have to download each one from the source by accepting their license agreements. 

To view this discussion on the web visit https://groups.google.com/d/msgid/edge-test-tool/81fe0dea-69fb-4f3c-9fd8-b7d4d89753bd%40googlegroups.com.