humann2 thread efficiency

65 views
Skip to first unread message

Billy Taj

unread,
Nov 5, 2019, 11:50:55 AM11/5/19
to HUMAnN Users
Hi, I'm running HUMAnN2 on a machine with many cores (40).
How are the threads used in HUMAnN2?  Is there internal job scheduling?
Will I see a dramatic increase in runtimes if I use all 40 cores, with the thread argument?

Eric Franzosa

unread,
Nov 5, 2019, 12:02:07 PM11/5/19
to humann...@googlegroups.com
The major speed-up from --threads N is that it's passed to the analogous bowtie2/diamond flags internally to tell those tools to use N threads. I have observed ~linear speed-ups during the rate-limiting diamond alignment stage when scaling from 1-24 threads.

Thanks,
Eric



--
You received this message because you are subscribed to the Google Groups "HUMAnN Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to humann-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/humann-users/6d294e7c-b89c-4130-9271-89f1412ae86e%40googlegroups.com.

Billy Taj

unread,
Nov 5, 2019, 12:10:52 PM11/5/19
to HUMAnN Users
Ahh, ok.  So the thread argument is passed to those tools, but it's not like HUMAnN2 will run multiple instances of them and do process management.  
Is this accurate?

Eric Franzosa

unread,
Nov 5, 2019, 12:15:38 PM11/5/19
to humann...@googlegroups.com
Correct - HUMAnN2 will not launch multiple instances of the alignment binaries.

Thanks,
Eric



On Tue, Nov 5, 2019 at 12:10 PM Billy Taj <bill...@gmail.com> wrote:
Ahh, ok.  So the thread argument is passed to those tools, but it's not like HUMAnN2 will run multiple instances of them and do process management.  
Is this accurate?

--
You received this message because you are subscribed to the Google Groups "HUMAnN Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to humann-users...@googlegroups.com.
Reply all
Reply to author
Forward
0 new messages