Upload Assistant fails to apply project-specific anonymisation script

[loren...@gmail.com]

Hi there, 

I have noticed that some images uploaded to our system (version 1.8.2.2, build: 4) using the XNAT Upload Assistant (v1.1.3) still had private tags despite the project-specific anonymisation script being enabled in the XNAT project where they were uploaded:

version "6.1" removeAllPrivateTags

Doing a bit of investigation, it seems to be a combination of XNAT Upload Assistant with something specific in these DICOM files. First, I only found a warning in restlet.log that I am not sure it's related, saying:

"[http-nio-8080-exec-28] WARN There appears to have been an issue launching pipeline AUTO_ARCHIVE for user admin on project XXX and experiment XXX"

Nothing in other logs. If I change to version 6.2 in the script, it won't even upload, complaining that the SOP Class UID is missing, which is wrong: I have checked the files and the one it specifically complains about has the SOP Class UID corresponding to CT.

I tried uploading the same files with the compressed uploader and it works fine, uploads and removes the tags, both with 6.1 and 6.2. in the script. 

Is this a known issue with the Upload Assistant? 

Thanks,

Lorena 

[Moore, Charlie]

Hi Lorena,

I'm fairly confident that the issue you're running into isn't really specific to the Upload Assistant, but is really an issue with older versions of DicomEdit 6. In particular, I suspect you're running into this: https://issues.xnat.org/browse/DE-17 . When uploading your data through the Compressed Uploader, the anonymization is done server-side within XNAT. Because you're on a recentish version of XNAT, the bundled version of DicomEdit 6 is therefore recent enough where this issue has been fixed. The Upload Assistant is very much another story. I don't exactly have the position to proclaim it officially "unsupported", but realistically speaking, that's about where it's at. The last release of it was quite a while ago, and so it has a highly outdated version of DicomEdit 6 bundled. When uploading via the assistant, anonymization is done client-side within the application, using the version of DicomEdit bundled in the application. I suspect the application fails when you try and specify "6.2" as a version because the Upload Assistant is so old that it doesn't even know what that is. The intended replacement (and supported) for the Upload Assistant is the XNAT Desktop Client: https://download.xnat.org/desktop-client/ .

Thanks,

Charlie

---

From: xnat_di...@googlegroups.com <xnat_di...@googlegroups.com> on behalf of loren...@gmail.com <loren...@gmail.com>
Sent: Tuesday, February 8, 2022 3:51 PM
To: xnat_discussion <xnat_di...@googlegroups.com>
Subject: [XNAT Discussion] Upload Assistant fails to apply project-specific anonymisation script

 

* External Email - Caution *

--
You received this message because you are subscribed to the Google Groups "xnat_discussion" group.
To unsubscribe from this group and stop receiving emails from it, send an email to xnat_discussi...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/xnat_discussion/cb2fa31d-d1f2-4e04-9f58-7c0aa795e51dn%40googlegroups.com.

 

---

The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

[loren...@gmail.com]

Thanks Charlie, 

That's very helpful! I think it has worked however with other datasets - something also specific of these images?

Best,

Lorena 

[Moore, Charlie]

Hi Lorena,

It's impossible for me to say without seeing the data, but if you're encountering that ticket (DE-17), it's definitely dependent on the data. Essentially, the problem wasn't that "removeAllPrivateTags" didn't do anything, but rather that it failed to remove certain types of private elements (namely, those embedded within sequences). If all of your previous datasets only had private elements at the root level in the DICOM objects, you wouldn't have seen that issue.

Thanks,

Charlie

---

From: xnat_di...@googlegroups.com <xnat_di...@googlegroups.com> on behalf of loren...@gmail.com <loren...@gmail.com>

Sent: Tuesday, February 8, 2022 5:07 PM
To: xnat_discussion <xnat_di...@googlegroups.com>
Subject: Re: [XNAT Discussion] Upload Assistant fails to apply project-specific anonymisation script

 

To view this discussion on the web visit https://groups.google.com/d/msgid/xnat_discussion/e9629928-e04b-429e-bfe0-4ab3f82186ben%40googlegroups.com.