BeeGFS Client Version 8.0.1 Failed to start on Ubuntu 20.04 with RDMA

[Zhi Yuan]

Dear BeeGFS members,

I have installed the beegfs-client on my Ubuntu 20.04, and it is failed to build.

=============================================================sudo systemctl status beegfs-client.service 
beegfs-client.service - Start BeeGFS Client
     Loaded: loaded (/lib/systemd/system/beegfs-client.service; enabled; vendor preset: enabled)
     Active: failed (Result: exit-code) since Wed 2025-06-11 16:38:02 +08; 20h ago
   Main PID: 445391 (code=exited, status=2)

Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[448181]:     4 | #include "../../compat/config.h"
Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[448181]:       |          ^~~~~~~~~~~~~~~~~~~~~~~
Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[448181]: compilation terminated.
Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[446875]: make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../sou>
Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[446280]: make[2]: *** [Makefile:1778: /opt/beegfs/src/client/client_module_8/build/../source] Error 2
Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[446013]: make[1]: *** [Makefile:200: module] Error 2
Jun 11 16:38:02 slabcluster01.slurm.slab.com beegfs-client[445419]: make: *** [AutoRebuild.mk:34: auto_rebuild] Error 2
Jun 11 16:38:02 slabcluster01.slurm.slab.com systemd[1]: beegfs-client.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Jun 11 16:38:02 slabcluster01.slurm.slab.com systemd[1]: beegfs-client.service: Failed with result 'exit-code'.
Jun 11 16:38:02 slabcluster01.slurm.slab.com systemd[1]: Failed to start Start BeeGFS Client.
=============================================================

sudo /etc/init.d/beegfs-client rebuild

- BeeGFS module autobuild
$OFED_INCLUDE_PATH = []
$OFED_INCLUDE_PATH = [/usr/src/mlnx-ofed-kernel-5.4/include/]
$OFED_INCLUDE_PATH = [/usr/src/mlnx-ofed-kernel-5.4/include/]
Building beegfs client module
feature detection gives: -DKERNEL_HAS_INODE_CTIME -DKERNEL_HAS_INODE_MTIME -DKERNEL_HAS_DENTRY_SUBDIRS -DKERNEL_HAS_SCHED_SIG_H -DKERNEL_HAS_STATX -DKERNEL_HAS_KREF_READ -DKERNEL_HAS_FILE_DENTRY -DKERNEL_HAS_SUPER_SETUP_BDI_NAME -DKERNEL_HAS_KERNEL_READ -DKERNEL_HAS_SKWQ_HAS_SLEEPER -DKERNEL_HAS_CURRENT_TIME_SPEC64 -DKERNEL_HAS_GET_FS -DKERNEL_HAS_IOV_ITER_KVEC_NO_TYPE_FLAG_IN_DIRECTION -DKERNEL_HAS_TIME64 -DKERNEL_HAS_KTIME_GET_TS64 -DKERNEL_HAS_KTIME_GET_REAL_TS64 -DKERNEL_HAS_KTIME_GET_COARSE_REAL_TS64 -DKERNEL_HAS_GENERIC_FILE_SPLICE_READ -DKERNEL_HAS_GENERIC_PERMISSION_2 -DKERNEL_HAS_SETATTR_PREPARE -DKERNEL_HAS_GET_ACL -DKERNEL_HAS_SET_ACL -DKERNEL_HAS_FOPS_ITERATE -DKERNEL_HAS_XATTR_HANDLERS_INODE_ARG
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/fault-inject/fault-inject.o] Error 1
make[3]: *** Waiting for unfinished jobs....
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/os/atomic64.o] Error 1
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/os/iov_iter.o] Error 1
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/os/OsDeps.o] Error 1
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/os/OsCompat.o] Error 1
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/net/message/NetMessageFactory.o] Error 1
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
In file included from ././include/linux/compiler_types.h:59,
                 from <command-line>:
/usr/src/mlnx-ofed-kernel-5.4/include/linux/compiler_attributes.h:4:10: fatal error: ../../compat/config.h: No such file or directory
    4 | #include "../../compat/config.h"
      |          ^~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/net/filesystem/FhgfsOpsCommKit.o] Error 1
make[3]: *** [scripts/Makefile.build:270: /opt/beegfs/src/client/client_module_8/build/../source/net/filesystem/FhgfsOpsRemoting.o] Error 1
make[2]: *** [Makefile:1778: /opt/beegfs/src/client/client_module_8/build/../source] Error 2
make[1]: *** [Makefile:200: module] Error 2
make: *** [AutoRebuild.mk:34: auto_rebuild] Error 2
=============================================================

Any ideas on this?

Thank you.

[kissu8]

1 check if below path exist and have ofed file
[/usr/src/mlnx-ofed-kernel-5.4/include/
2. make sure you add --add-kernel-support when you install mellanox driver.

[Zhi Yuan]

Hello Kissu8, I have tried to uninstall mellanox via "uninstall.sh" and run "./mlnxofedinstall --add-kernel-support" and reboot.

After reboot, here is my list under /usr/src:

linux-headers-5.15.0-143          

linux-headers-5.15.0-144          

nvidia-550.67
linux-headers-5.15.0-143-generic  

linux-headers-5.15.0-144-generic  

ofa_kernel

Should I put "/usr/src/ofa_kernel" instead on my "/etc/beegfs/beegfs-client-autobuild.conf"?

--
You received this message because you are subscribed to a topic in the Google Groups "beegfs-user" group.
To unsubscribe from this topic, visit https://groups.google.com/d/topic/fhgfs-user/UvdKeYZZxVY/unsubscribe.
To unsubscribe from this group and all its topics, send an email to fhgfs-user+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/fhgfs-user/cd675264-c916-42c6-836c-bc26f2dfd124n%40googlegroups.com.

[Zhi Yuan]

I have reinstalled the MLNX_OFED_LINUX-24.01 drivers via the commands below and it works like a charm:

sudo ./uninstall.sh

sudo reboot
cd /MLNX_OFED_LINUX-24.01/

sudo ./mlnxofedinstall --add-kernel-support

sudo nano /etc/beegfs/beegfs-client-autobuild.conf

• buildArgs=-j8 OFED_INCLUDE_PATH=/usr/src/ofa_kernel/default/include

sudo /etc/init.d/beegfs-client rebuild

sudo /etc/init.d/beegfs-client restart

sudo systemctl status beegfs-client

@Kissu8, Thank you so much!!!

[郭益玮]

不客气，官方没支持我们只能自己摸索了。
8.01还有很多问题我也没解决。

Zhi Yuan <zhiyu...@gmail.com> 于2025年7月29日周二 22:48写道：

--
You received this message because you are subscribed to the Google Groups "beegfs-user" group.
To unsubscribe from this group and stop receiving emails from it, send an email to fhgfs-user+...@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/fhgfs-user/13289455-d1d9-45c4-830f-93486b058739n%40googlegroups.com.