cuda test compile fails with denied access to /local/scratch on cluster

[Bryan VanSaders]

Hi,

I'm trying to compile a (so far unmodified) mirror of hoomd 4.2 from source on a cluster environment. I'm running into a problem with cuda. During configuration with ccmake, I get the following error:

Make Error at /usr/share/cmake/Modules/CMakeTestCUDACompiler.cmake:46 (message):
   The CUDA compiler

     "/cm/shared/apps/cuda11.4/toolkit/11.4.2/bin/nvcc"

   is not able to compile a simple test program.

   It fails with the following output:

     Change Dir: /home/bv336/v-hoomd/build/CMakeFiles/CMakeTmp

     Run Build Command:"/usr/bin/gmake" "cmTC_e550a/fast"
     /usr/bin/gmake -f CMakeFiles/cmTC_e550a.dir/build.make CMakeFiles/cmTC_e550a.dir/build
     gmake[1]: Entering directory '/home/bv336/v-hoomd/build/CMakeFiles/CMakeTmp'
     Building CUDA object CMakeFiles/cmTC_e550a.dir/main.cu.o
     /cm/shared/apps/cuda11.4/toolkit/11.4.2/bin/nvcc     -x cu -c /home/bv336/v-hoomd/build/CMakeFiles/CMakeTmp/main.cu -o CMakeFiles/cmTC_e550a.dir/main.cu.o
     nvcc fatal   : Could not open output file '/local/scratch/tmpxft_00007dde_0000000a'
     gmake[1]: *** [CMakeFiles/cmTC_e550a.dir/build.make:66: CMakeFiles/cmTC_e550a.dir/main.cu.o] Error 1
     gmake[1]: Leaving directory '/home/bv336/v-hoomd/build/CMakeFiles/CMakeTmp'
     gmake: *** [Makefile:126: cmTC_e550a/fast] Error 2




   CMake will not be able to correctly generate this project.
 Call Stack (most recent call first):
   CMake/hoomd/HOOMDHIPSetup.cmake:14 (ENABLE_LANGUAGE)
   CMakeLists.txt:111 (include)

As you can see, the test compilation is trying to access /local/scratch , which on this cluster is not a place that I can write to. This error prevents generating the project with ENABLE_GPU=ON.

How can I circumvent this? I thought to modify the test cuda file to write to somewhere I have access to, but I'm having a hard time tracking down exactly where that file comes from (build/CMakeFiles/CMakeTmp/ is empty when I inspect it). 

Any advice is appreciated.

Thanks,

Bryan

[Lourens Veen]

Hi Bryan,

Is your TMPDIR environment variable set to /local/scratch by any chance?

Best,

Lourens

| Lourens Veen | Senior eScience Research Engineer | Email: l.v...@esciencecenter.nl |

| Netherlands eScience Center | Science Park 402 | 1098 XH Amsterdam | The Netherlands |

---

From: hoomd...@googlegroups.com <hoomd...@googlegroups.com> on behalf of Bryan VanSaders <bvans...@gmail.com>
Sent: Thursday, October 19, 2023 18:21
To: hoomd-users <hoomd...@googlegroups.com>
Subject: [hoomd-users] cuda test compile fails with denied access to /local/scratch on cluster

 

--
You received this message because you are subscribed to the Google Groups "hoomd-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to hoomd-users...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/hoomd-users/f56f7db3-2a4a-46bd-94e5-88ad7fa57500n%40googlegroups.com.

[Bryan VanSaders]

Lourens,

That was exactly my problem, thank you

-Bryan