Marian 1.10 compilation slow

52 views
Skip to first unread message

tuck...@gmail.com

unread,
Feb 8, 2021, 10:51:49 AM2/8/21
to marian-nmt

Hi all,

 

thank you for releasing the new Marian version 1.10!

 

 

We noticed that this release seems to roughly double the compilation time required to build marian (on our system with “-j8” from 30 minutes to 60minutes)

Also near the beginning of the output of make we now get

“make[3]: warning: jobserver unavailable: using -j1.  Add '+' to parent make rule.”

 

This was not present previously, and it seems to me that during compilation of the CUDA kernels only a single CPU core is used. However I’m not entirely sure if it’s actually related.

Is there something that can be done to build CUDA kernels in parallel or in general to speed up the build?

 

Any hints are greatly appreciated!

 

Best regards

Patrick

Marcin Junczys-Dowmunt

unread,
Feb 8, 2021, 1:01:33 PM2/8/21
to maria...@googlegroups.com

Ah. That’s already fixed in another place and should be available in Marian 1.11 later this or next week. A quick fix is to replace in file

marian-dev/src/3rd_party/CMakeLists.txt

 

${CMAKE_MAKE_PROGRAM} with "\$(MAKE)"

 

Note the quotes.

--
You received this message because you are subscribed to the Google Groups "marian-nmt" group.
To unsubscribe from this group and stop receiving emails from it, send an email to marian-nmt+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/marian-nmt/4c4d7324-c050-4d43-849f-3c41641069d0n%40googlegroups.com.

 

tuck...@gmail.com

unread,
Feb 9, 2021, 5:48:21 AM2/9/21
to marian-nmt
Thanks a lot! This brings compilation time back down to ~30 minutes for me
Reply all
Reply to author
Forward
Message has been deleted
0 new messages