nextflow.config and AWS Batch job definition

252 views
Skip to first unread message

st...@marshalldatasolutions.com

unread,
Mar 13, 2019, 8:31:58 AM3/13/19
to Nextflow
Hi

I want to use a specific job definition that I've already created but I get this error message so I'm wondering if my syntax is incorrect

[warm up] executor > awsbatch
ERROR ~ Error executing process > 'fastqc (FASTQC on ggal_liver)'

Caused by:
  Invalid AWS Batch job definition -- provide a Docker image name or a Batch job definition name

My nextflow.config... if I use my ECR image that works but then it creates a new job def with some default settings. I can change those but it seems like according to the documentation I should be able to use the job def.

profiles {

    awsbatch {
        aws.region = 'us-east-1'
        aws.client.storageEncryption = 'AES256'
        aws.accessKey = 'XXXXXXXXX'
        aws.secretKey = 'XXXXXXXXX'
        process.containter = 'job-definition/Batch-Genomics-CompBio-Dev:3'
process.queue = 'BatchJobQueue'
        executor.name = 'awsbatch'
workDir = 's3://XXXXXX/nextflow/test/data'
        executor.awscli = '/opt/conda/bin/aws'
    }

}

I'm using this version

N E X T F L O W
      version 19.01.0 build 5050
      last modified 22-01-2019 11:19 UTC 
      cite doi:10.1038/nbt.3820
Reply all
Reply to author
Forward
0 new messages