HCPpipelines eddy_postproc.sh Error

101 views
Skip to first unread message

Wenlan Zhang

unread,
Jul 8, 2021, 7:30:03 PM7/8/21
to HCP-Users
Dear HCP experts, 

I am hoping to run the Diffusion Preprocessing pipelines on one subject (subject HCD0042420) from the HCP-D dataset. Currently, I am doing non-GPU enabled eddy and gradient nonlinearity distortion correction. The pre-Eddy and Eddy steps seem to have gone well, however I am getting an error at the post processing step (the first error message is highlighted in yellow): 

START: eddy_postproc
Generating eddy QC report in /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/QC
Traceback (most recent call last):
  File "/export01/local/fsl/bin/eddy_quad", line 54, in <module>
    main(args.eddyBase, args.eddyIdx, args.eddyParams, args.mask, args.bvals, args.bvecs, args.output_dir, args.field, args.slspec, args.verbose)
  File "/export01/local/fsl/fslpython/envs/fslpython/lib/python3.7/site-packages/eddy_qc/QUAD/quad.py", line 63, in main
    raise ValueError(eddyBase + ' does not appear to be a valid EDDY output basename')
ValueError: /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/eddy_unwarped_images does not appear to be a valid EDDY output basename
Thu Jul  8 15:43:13 EDT 2021:eddy_postproc.sh: While running '/local_raid/data/HCPD/HCPpipelines-master/DiffusionPreprocessing/scripts/eddy_postproc.sh /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion /local_raid/data/HCPD/HCPpipelines-master/global/config/coeff_AS82.grad 1 0':
Thu Jul  8 15:43:13 EDT 2021:eddy_postproc.sh: ERROR: '/export01/local/fsl/bin/eddy_quad' command failed with return code: 1
Thu Jul  8 15:43:13 EDT 2021:eddy_postproc.sh: ERROR: '/export01/local/fsl/bin/eddy_quad' command failed with return code: 1

===> ERROR: Command returned with nonzero exit code
---------------------------------------------------
         script: eddy_postproc.sh
stopped at line: 35
           call: "${qc_command[@]}"
  expanded call: /export01/local/fsl/bin/eddy_quad /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/eddy_unwarped_images -idx /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/index.txt -par /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/acqparams.txt -m /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/nodif_brain_mask.nii.gz -b /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/Pos_Neg.bvals -g /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/eddy/eddy_unwarped_images.eddy_rotated_bvecs -o /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/QC -f /local_raid/data/HCPD/HCPpipelines-master/testdata/HCD0042420_V1_MR/Diffusion/topup/topup_Pos_Neg_b0_field.nii.gz -v
      exit code: 1
---------------------------------------------------

===> Aborting execution!


Would anyone possibly have clues to the cause or solution of this error? 

Looking into quad.py (line 63), it looks like the eddyBase file should be an ".nii" or ".nii.gz" file. However, in the expanded call it seems that the eddyBase file name is "eddy_unwarped_images". Could this possibly be the error? 

Thank you for your help, 
Best, 
Shirley 

Glasser, Matthew

unread,
Jul 8, 2021, 7:34:07 PM7/8/21
to hcp-...@humanconnectome.org

I bet eddy did not finish correctly and there is an earlier error.  We are actively running this preprocessing now for the “official” data, but getting the data released on NDA is a process…

 

Matt.

--
You received this message because you are subscribed to the Google Groups "HCP-Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hcp-users+...@humanconnectome.org.
To view this discussion on the web visit https://groups.google.com/a/humanconnectome.org/d/msgid/hcp-users/80fd205e-fd8f-4f6c-a841-a963aa4e6015n%40humanconnectome.org.

 


The materials in this message are private and may contain Protected Healthcare Information or other information of a sensitive nature. If you are not the intended recipient, be advised that any unauthorized use, disclosure, copying or the taking of any action in reliance on the contents of this information is strictly prohibited. If you have received this email in error, please immediately notify the sender via telephone or return mail.

Wenlan Zhang

unread,
Jul 8, 2021, 8:31:04 PM7/8/21
to HCP-Users, glas...@wustl.edu
Hi Matt, 

That makes sense- it could be something to do with eddy_openmp, which is taking a very long time (>12 hours). 

I'm also going back and double checking my input parameters. Would you happen to know what echo spacing value is being used the preprocess the official HCP-D data? My echo spacing value currently is 0.689998. 

Thanks, 
Shirley 

Glasser, Matthew

unread,
Jul 8, 2021, 8:33:10 PM7/8/21
to Wenlan Zhang, HCP-Users

The scanner protocol PDF I have says 0.69ms.

Harms, Michael

unread,
Jul 8, 2021, 10:11:04 PM7/8/21
to hcp-...@humanconnectome.org, Wenlan Zhang

 

Just as an FYI, we’ve worked with Jesper to develop to what we consider an optimal set of parameters for processing this data through ‘eddy’.

 

Cheers,

-MH

 

 

-- 

Michael Harms, Ph.D.

-----------------------------------------------------------

Associate Professor of Psychiatry

Washington University School of Medicine

Department of Psychiatry, Box 8134

660 South Euclid Ave.                        Tel: 314-747-6173

St. Louis, MO  63110                          Email: mha...@wustl.edu

 

From: "Glasser, Matthew" <glas...@wustl.edu>
Reply-To: "hcp-...@humanconnectome.org" <hcp-...@humanconnectome.org>
Date: Thursday, July 8, 2021 at 7:33 PM
To: Wenlan Zhang <wenlan.zh...@gmail.com>, HCP-Users <hcp-...@humanconnectome.org>
Subject: Re: [hcp-users] HCPpipelines eddy_postproc.sh Error

 

* External Email - Caution *

Reply all
Reply to author
Forward
0 new messages