Parallel Computing on Cluster

[Teddy Gonzales]

Hello, 

I have been having problem using m2 on a cluster. I am running it through apptainer and it seems like I cannot get maxAllowableThreads to be greater than 17 even though I have allocated many more cpus than this. Any tips? 

Thank you

[Mahrud Sayrafi]

Hi Teddy,

The maximum number of threads is capped artificially here. Parallelization has improved recently, so it may be time to remove that cap in the next release.

To lift this you would have to change that line and compile M2 from source. I'm not sure what apptainer is, but if you run into trouble building M2 from source feel free to open an issue on GitHub.

Best,

Mahrud

--
You received this message because you are subscribed to the Google Groups "Macaulay2" group.
To unsubscribe from this group and stop receiving emails from it, send an email to macaulay2+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/macaulay2/dc74cc3f-90eb-4fbe-9a4e-f99c6a21614an%40googlegroups.com.

[Luke Oeding]

I'm trying to run M2 on a couple of different servers that have either 64 or 96 cores. But I'm not able to compile from source on those machines. Is there another way to access the full power of these machines?

[Thomas Kahle]

Hi, since nobody has replied, let me say “use AI”:
There is something called ‘cross-compiling’ which means to compile on machine A a binary that runs on machine B. The more similar the machines the better, but it’s not strictly required. So give claude passwortless ssh to your cluster machine, let it gather all the info it needs and then tell it to cross-compile M2 for that machine. It will find a way ;)

Good luck,
Thomas

To view this discussion visit https://groups.google.com/d/msgid/macaulay2/e89f445b-3e7e-43c8-b069-2fe9e6655c91n%40googlegroups.com.

--
Thomas Kahle
https://www.thomas-kahle.de