debug setup to find AWS Batch executor

82 views
Skip to first unread message

John Kern

unread,
Oct 13, 2021, 8:40:24 PM10/13/21
to Nextflow
Hello,

I want to investigate this issue.

Nextflow 20.10 doesn't recognize AWS China credential?

The initial test case effectively a hello world process.

$ cat ~/src/sleep.nf

process sayHello {
"""
sleep 300
"""
}

I checkout the source code.
* make compile
* ./launch.sh ~/src/sleep.nf

$ ./launch.sh ~/src/sleep.nf
N E X T F L O W ~ version 21.09.0-edge
Launching `/home/jkern/src/sleep.nf` [magical_spence] - revision: bd690f3715
executor > local (1)
[5e/ef523e] process > sayHello [100%] 1 of 1 ✔
Completed at: 14-Oct-2021 00:26:06
Duration : 5m 1s
CPU hours : 0.1
Succeeded : 1

On the local machine it works fine but if it define the AWS Batch executor, it fails

$ ./launch.sh ~/src/testcase-cn.nf
N E X T F L O W ~ version 21.09.0-edge
Launching `/home/jkern/src/testcase-cn.nf` [compassionate_curran] - revision: bfa880bcf4
Unknown executor name: awsbatch

The process is the same as sleep.nf except I define process.executor, process.queue and process.container

$ cat ~/src/testcase-cn.nf
process sayHello {
executor = "awsbatch"
queue = "compute_3"
container = "...omitted..."
"""
sleep 300
"""
}

Do i need to download AWS batch dependencies or augment my environment to find the plugins? 

Thanks for your time and consideration.

Sincerely,
John

Paolo Di Tommaso

unread,
Oct 15, 2021, 5:52:31 AM10/15/21
to nextflow
Since the execution is not defined in the nextflow config file, NF cannot infer the need for the plugin. Either run it adding the `-plugins nf-amazon` option or add in the config 

```
process.executor = 'awsbatch` 
```


--
You received this message because you are subscribed to the Google Groups "Nextflow" group.
To unsubscribe from this group and stop receiving emails from it, send an email to nextflow+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/nextflow/b5ac6ce7-f7a5-406a-9066-d6f012be6f9fn%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages