Error while installing trilinos and dealii with candi on Stampede2

[Jau-Uei Chen]

Dear dealii community,

I am trying to install dealii v9.2.0 with candi on stampede2 by following instruction shown in here. I encounter errors when installing dealii and trilinos.

My modules are:

  1) git/2.24.1     3) xalt/2.8   5) gcc/7.1.0     7) python/2.7.13   9) autotools/1.1

  2) cmake/3.16.1   4) TACC       6) impi/17.0.3   8) mkl/17.0.4

By using the latest version of candi, I only change DEAL_CONFOPTS to

DEAL_CONFOPTS="-D DEAL_II_FORCE_BUNDLED_THREADS=ON"

and MKL setting to:

MKL=ON

MKL_DIR=$MKLROOT/lib/intel64

However, I got an error when installing trilinos:

CMake Error at cmake/tribits/core/package_arch/TribitsAdjustPackageEnables.cmake:1098 (MESSAGE):

   ***

   *** ERROR: Setting Trilinos_ENABLE_Amesos2=OFF which was 'ON' because Amesos2 has a required library dependence on disabled package Tpetra!

   ***

It seems that it happened when installing trilinos with MKL (see here) though it seems to be resolved. I noted that in the post they use "intel" however, to use MKL, I have to use gcc in stampede2. I also tried to install the older version of trilinos (v12-10-1) by slightly modifying "trilinos.package" but it did not work neither. 

Out of curiosity, I skip trilinos and install the rest of packages including dealii. However, I got an error when installing dealii:

-- A library with LAPACK API found.

-- Performing Test mpifort_LIBRARY

-- Performing Test mpifort_LIBRARY - Success

-- Performing Test mpi_LIBRARY

-- Performing Test mpi_LIBRARY - Success

-- Performing Test mpigi_LIBRARY

-- Performing Test mpigi_LIBRARY - Success

-- Performing Test dl_LIBRARY

-- Performing Test dl_LIBRARY - Success

-- Performing Test pthread_LIBRARY

-- Performing Test pthread_LIBRARY - Success

-- Performing Test gfortran_LIBRARY

-- Performing Test gfortran_LIBRARY - Success

-- Performing Test m_LIBRARY

-- Performing Test m_LIBRARY - Success

-- Performing Test gcc_s_LIBRARY

-- Performing Test gcc_s_LIBRARY - Success

-- Performing Test gcc_LIBRARY

-- Performing Test gcc_LIBRARY - Success

-- Performing Test quadmath_LIBRARY

-- Performing Test quadmath_LIBRARY - Success

-- Performing Test c_LIBRARY

-- Performing Test c_LIBRARY - Success

--   LAPACK_LIBRARIES: *** Required variable "_lapack_libraries" empty ***

--   LAPACK_LINKER_FLAGS:

--   LAPACK_INCLUDE_DIRS:

--   LAPACK_USER_INCLUDE_DIRS:

-- Could NOT find LAPACK

-- DEAL_II_WITH_LAPACK has unmet external dependencies.

CMake Error at cmake/macros/macro_configure_feature.cmake:112 (MESSAGE):

  Could not find the lapack library!

  Please ensure that a suitable lapack library is installed on your computer.

  If the library is not at a default location, either provide some hints for

  autodetection,

      $ LAPACK_DIR="..." cmake <...>

      $ cmake -DLAPACK_DIR="..." <...>

  or set the relevant variables by hand in ccmake.

It seems also happened before (see here and here). I tried different setting in MKL and DEAL_CONFOPTS that are mentioned in the posts but none of them work for me. (To link Lapack in stampede2, I referent to here.)

i.e. 

• DEAL_CONFOPTS="-DLAPACK_DIR=${TACC_MKL_DIR}/lib/intel64_lin/libmkl_intel_lp64.so;${TACC_MKL_DIR}/lib/intel64_lin/libmkl_core.so" 
  
• DEAL_CONFOPTS="-DLAPACK_DIR=${TACC_MKL_DIR}"
  

or in MKL section

• LAPACK_DIR=${TACC_MKL_LIB}
• LAPACK_LIBRARIES="${TACC_MKL_DIR}/lib/intel64_lin/libmkl_intel_lp64.so;${TACC_MKL_DIR}/lib/intel64_lin/libmkl_core.so"
• DLAPACK_LIBRARIES="${TACC_MKL_DIR}/lib/intel64_lin/libmkl_intel_lp64.so;${TACC_MKL_DIR}/lib/intel64_lin/libmkl_core.so"

Any suggestion or comment will be greatly appreciated!

Best,

Jau-Uei Chen

[Aaditya Lakshmanan]

Hi,

    There are pre-existing deal.ii modules on Stampede2 about which you can find out by using the module spider command :

module spider dealii

Output :

---------------------------------------------------------------------------------------------------------------------------------------------------------

  dealii:

---------------------------------------------------------------------------------------------------------------------------------------------------------

    Description:

      Portable Extendible Toolkit for Scientific Computing, Numerical library for sparse linear algebra

     Versions:

        dealii/git20170615

        dealii/9.0.0

        dealii/9.1.1

        dealii/9.2.0

---------------------------------------------------------------------------------------------------------------------------------------------------------

  For detailed information about a specific "dealii" package (including how to load the modules) use the module's full name.

  Note that names that have a trailing (E) are extensions provided by other modules.

  For example:

     $ module spider dealii/9.2.0

---------------------------------------------------------------------------------------------------------------------------------------------------------

 Is there a specific reason you want to install it manually?

Best,

Aaditya

[Jau-Uei Chen]

My apologize to my ignorance. 

I did not realize that we have pre-existing dealii modules on Stampede2 so I tired to install it manually. I am happy with using it directly.

Thanks for your prompt response!

Jau-Uei Chen

aadit...@gmail.com 在 2020年11月23日 星期一上午10:56:57 [UTC-6] 的信中寫道：