Quality control procedures after pre-processing

258 views
Skip to first unread message

Yang Hu

unread,
Feb 10, 2025, 7:31:48 AM2/10/25
to HCP-Users
Dear experts,

I am new to HCP Pipelines and HCP datasets. I just followed the documentation to complete the pre-processing of the example subject data. Specifically, I run the following scripts (version 5.0.0) in order:

## T1/T2 processing
1. PreFreeSurferPipelineBatch.sh
2. FreeSurferPipelineBatch.sh
3. PostFreeSurferPipelineBatch.sh
## REST processing (I am currently only interested in REST fMRI)
1. GenericfMRIVolumeProcessingPipelineBatch.sh
2. GenericfMRISurfaceProcessingPipelineBatch.sh
3. IcaFixProcessingBatch.sh (I use multi-run FIX)
4. PostFixBatch.sh
5. MSMAllPipelineBatch.sh
6. DeDriftAndResamplePipelineBatch.sh
## DWI processing
1. DiffusionPreprocessingBatch.sh

My questions:

1. For HCP released datasets (I am currently interested in HCP-Aging), the quality of raw data was checked and thus only acceptable data was released? Or It is necessary to check the raw data quality by myself?
2. For DWI processing, I found the Diffusion/QC/qc.pdf generated by Eddy Quad, which contains the key quality metrics about DWI. I would also like to check the DWI-T1 registration results, and which image pairs should I check (the source and target files in registration)?
3. For T1/T2 processing, I found four png files in the MNINonLinear/StructuralQC/snapshots folder but I did not know the meaning of each figure. Which figure I should check to ensure the accuracy?
4. For REST processing, I found two png files in the /MNINonLinear/Results/rfMRI_REST1_AP/fMRIQC/snapshots folder and the figures seems used for checking REST-T1 registration accuracy. I would also like  to check the average head motion measure and I found Movement_AbsoluteRMS_mean.txt/Movement_RelativeRMS_mean.txt in the /MNINonLinear/Results/rfMRI_REST1_AP/fMRIQC/ folder. How the AbsoluteRMS and RelativeRMS were defined (I am only familiar with Power's mean FD)? The same way used in Eddy Quad? I know that I should check the FIX classified results, which I think should be very robust because the trained model was also based on HCP dataset, so that it may be unnecessary.
5. Besides the procedures I mentioned, any other procedures should I take? Any guidance would be highly appreciated.

Many thanks!
 
Yang Hu


Reid, Erin

unread,
Feb 10, 2025, 5:27:41 PM2/10/25
to HCP-Users
Hello Yang Hu,
Regarding #1, all T1w & T2w scans were visually examined before they were sent through the pipelines. If quality was subpar, a recollection was requested.

Regarding #3, all FreeSurfer results were visually examined as well. Some of them just by viewing the png files in the individual's MNINonLinear/StructuralQC/snapshots folder. However, most of the data was examined using the [subject].structuralQC.wb_scene in Workbench (wb_view) in order to rotate and view the entire surface as well as scroll through every slice of the MRI displaying the white and pial surface outlines. 
There should be no need for anyone to do another round of quality control on the data, but if you do find something notable, we would appreciate the heads up.

Hopefully one of my colleagues will be able to help you with your other questions regarding DWI and REST processing.

Sincerely,
Erin Reid (she/her) | Sr Research Technician

Department of Neuroscience

From: Yang Hu <huyan...@gmail.com>
Sent: Monday, February 10, 2025 6:31 AM
To: HCP-Users <hcp-...@humanconnectome.org>
Subject: [hcp-users] Quality control procedures after pre-processing
 
--
You received this message because you are subscribed to the Google Groups "HCP-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hcp-users+...@humanconnectome.org.
To view this discussion visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/6dc9d55a-b5c3-471c-b478-5695ad773136n%40humanconnectome.org.

 


The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

Harms, Michael

unread,
Feb 10, 2025, 6:17:39 PM2/10/25
to hcp-...@humanconnectome.org

Hi,

If you haven’t already, load the actual scene files in the StructuralQC and fMRIQC folders.  The scene descriptions contain a lot of helpful information about what each scene (and thus each png snapshot) contains.

 

Absolute and Relative RMS use the FSL output from ‘mcflirt’ to define the summary movement measures. There used to be a relevant FSL technical document online, which you might be able to find on the FSL Wiki, or by searching the FSL archives.  IIRC, the RelativeRMS values from ‘mcflirt’ are approximately one-half of Power’s FD definition of relative movement.

 

‘eddy’ has its own separate definition of absolute and relative movement.   I don’t believe they are the same as ‘mcflirt’s.

 

Cheers,

-MH

 

-- 

Michael Harms, Ph.D.

-----------------------------------------------------------

Professor of Psychiatry

Washington University School of Medicine

Department of Psychiatry, Box 8134

660 South Euclid Ave.                        Tel: 314-747-6173

St. Louis, MO  63110                          Email: mha...@wustl.edu

 

From: "'Reid, Erin' via HCP-Users" <hcp-...@humanconnectome.org>
Reply-To: "hcp-...@humanconnectome.org" <hcp-...@humanconnectome.org>
Date: Monday, February 10, 2025 at 4:29 PM


To: HCP-Users <hcp-...@humanconnectome.org>
Subject: Re: [hcp-users] Quality control procedures after pre-processing

Glasser, Matthew

unread,
Feb 10, 2025, 9:50:07 PM2/10/25
to hcp-...@humanconnectome.org

We run some additional pipelines in HCP Lifespan to better clean the fMRI (improved spatial ICA classification and temporal ICA cleanup).  Perhaps one day those data will be available for download somewhere (and for HCP-YA too).

 

Matt.

Yang Hu

unread,
Feb 10, 2025, 11:05:04 PM2/10/25
to HCP-Users, er...@wustl.edu
Dear Erin,

Thank you for your help. To confirm my understanding, if I plan to use the pre-processed HCP dataset released by the HCP CCF, it is not necessary to check the pre-processing results. However, if I decide to re-run the pre-processing of raw HCP data (e.g., because the pre-processed one has not yet been released), would I still need to ensure the quality after pre-processing? I believe that visually checking the snapshots would be enough, because the raw data quality was already examined before release and HCP Pipelines should be generally robust.

Sincerely,

Yang Hu

Harms, Michael

unread,
Feb 10, 2025, 11:17:43 PM2/10/25
to hcp-...@humanconnectome.org, Reid, Erin

Just so there is no confusion, Erin was writing specifically about the structural QC.

 

The quality of the fMRI and dMRI data in the HCP processed data will vary across individuals and some level of review is appropriate and warranted.

 

-- 

Michael Harms, Ph.D.

-----------------------------------------------------------

Professor of Psychiatry

Washington University School of Medicine

Department of Psychiatry, Box 8134

660 South Euclid Ave.                        Tel: 314-747-6173

St. Louis, MO  63110                          Email: mha...@wustl.edu

 

From: Yang Hu <huyan...@gmail.com>
Reply-To: "hcp-...@humanconnectome.org" <hcp-...@humanconnectome.org>
Date: Monday, February 10, 2025 at 10:05 PM
To: HCP-Users <hcp-...@humanconnectome.org>
Cc: "Reid, Erin" <er...@wustl.edu>
Subject: Re: [hcp-users] Quality control procedures after pre-processing

 

Dear Erin,

Thank you for your help. To confirm my understanding, if I plan to use the pre-processed HCP dataset released by the HCP CCF, it is not necessary to check the pre-processing results. However, if I decide to re-run the pre-processing of raw HCP data (e.g., because the pre-processed one has not yet been released), would I still need to ensure the quality after pre-processing? I believe that visually checking the snapshots would be enough, because the raw data quality was already examined before release and HCP Pipelines should be generally robust.

Sincerely,

Yang Hu

2025211日星期二 UTC+8 06:27:41<er...@wustl.edu> 写道:

Hello Yang Hu,

Regarding #1, all T1w & T2w scans were visually examined before they were sent through the pipelines. If quality was subpar, a recollection was requested.

 

Regarding #3, all FreeSurfer results were visually examined as well. Some of them just by viewing the png files in the individual's MNINonLinear/StructuralQC/snapshots folder. However, most of the data was examined using the [subject].structuralQC.wb_scene in Workbench (wb_view) in order to rotate and view the entire surface as well as scroll through every slice of the MRI displaying the white and pial surface outlines. 

There should be no need for anyone to do another round of quality control on the data, but if you do find something notable, we would appreciate the heads up.

 

Hopefully one of my colleagues will be able to help you with your other questions regarding DWI and REST processing.

 

Sincerely,

Erin Reid (she/her) | Sr Research Technician

Image removed by sender.

Department of Neuroscience

Yang Hu

unread,
Feb 11, 2025, 12:00:02 AM2/11/25
to HCP-Users, mha...@wustl.edu

Dear Michael,

  1. Based on the scene file, I was able to figure out the purpose of each PNG figure. I am still learning the Workbench and the HCP framework, which poses a significant challenge for me.

  2. After doing some research, I believe that the RelativeRMS metric corresponds to Jenkinson's FD as cited in some papers. According to FSL's fsl_motion_outliers documentation (https://fsl.fmrib.ox.ac.uk/fsl/docs/#/registration/motion_outliers), RelativeRMS should be equivalent to the --fdrms option. The difference between RelativeRMS and AbsoluteRMS lies in the reference volume used: for RelativeRMS, the reference is the previous volume, while for AbsoluteRMS, the reference may be the first volume or the motion correction reference volume (e.g., the SBRef image). For quality control of head motion, RelativeRMS should be used. If my understanding is incorrect, please let me know.

  3. Thank you for the reminder about the structural QC.

Sincerely,
Yang Hu

Yang Hu

unread,
Feb 11, 2025, 12:20:54 AM2/11/25
to HCP-Users, glas...@wustl.edu

Dear Matt,

Thank you for the information. I would like to stay updated with these advancements after I complete the basic workflow. As I am new to the HCP Pipelines, I have read the Glasser et al. (2013) and Glasser et al. (2018) papers (though many details require more time to fully digest). Are there any other key methodological papers specific to the HCP Pipelines that I should read (besides those related to FreeSurfer/FSL tools)? Is there an official list of reference papers that you would recommend?

References:
Glasser, M. F., Sotiropoulos, S. N., Wilson, J. A., Coalson, T. S., Fischl, B., Andersson, J. L., ... & Wu-Minn HCP Consortium. (2013). The minimal preprocessing pipelines for the Human Connectome Project. Neuroimage, 80, 105-124.

Glasser, M. F., Coalson, T. S., Bijsterbosch, J. D., Harrison, S. J., Harms, M. P., Anticevic, A., ... & Smith, S. M. (2018). Using temporal ICA to selectively remove global noise while preserving global signal in functional MRI data. Neuroimage, 181, 692-717.

Sincerely,
Yang Hu

Glasser, Matthew

unread,
Feb 12, 2025, 2:42:11 PM2/12/25
to Yang Hu, HCP-Users

Other worthwhile papers to read include Glasser et al., 2016 Nature, Glasser et al., 2016 Nature Neuroscience, Coalson et al., 2018 PNAS, Glasser et al., 2019 Neuroimage, and Glasser et al., 2022 Neuroimage.


Matt.

 

From: Yang Hu <huyan...@gmail.com>


Date: Monday, February 10, 2025 at 11:20 PM
To: HCP-Users <hcp-...@humanconnectome.org>

Image removed by sender.

Department of Neuroscience

Reply all
Reply to author
Forward
0 new messages