Linux kernel 5.15.0-112-generic and beegfs-client/unknown,now 20:7.3.1 all

[Peter van den Berg]

Hi,

After an upgrade to the latest kernel on Ubuntu 22.04 beegfs-client breaks. 

kernel: Linux kernel 5.15.0-112-generic

apt package: beegfs-client/unknown,now 20:7.3.1 all

Error: 

Jun 11 17:00:23 vulcan systemd[1]: Starting Start BeeGFS Client...
Jun 11 17:00:23 vulcan beegfs-client[2570403]: Starting BeeGFS Client:
Jun 11 17:00:23 vulcan beegfs-client[2570403]: - Loading BeeGFS modules
Jun 11 17:00:23 vulcan beegfs-client[2570406]: modprobe: FATAL: Module beegfs not found in directory /lib/modules/5.15.0-112-generic
Jun 11 17:00:23 vulcan beegfs-client[2570403]: - BeeGFS module autobuild
Jun 11 17:00:23 vulcan beegfs-client[2571137]: Building beegfs client module
Jun 11 17:00:38 vulcan beegfs-client[2571377]: feature detection gives: -DKERNEL_HAS_SCHED_SIG_H -DKERNEL_HAS_STATX -DKERNEL_HAS_KREF_READ -DKERNEL_HAS_FILE_DENTRY -DKERNEL_HAS_SUPER_SETUP_BDI_NAME -DKERNEL_HAS_KERNEL_READ -DKERNEL_HAS_SKWQ_HAS>
Jun 11 17:00:39 vulcan beegfs-client[2572439]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c: In function ‘__NIC_fillNicAddress’:
Jun 11 17:00:39 vulcan beegfs-client[2572439]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:120:47: error: invalid application of ‘sizeof’ to incomplete type ‘char[]’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:   120 |       memset(ifr.ifr_hwaddr.sa_data, 0, sizeof(ifr.ifr_hwaddr.sa_data) );
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                                               ^
Jun 11 17:00:39 vulcan beegfs-client[2572439]: In file included from ./include/linux/kernel.h:16,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from ./include/linux/list.h:9,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from ./include/linux/module.h:12,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/Common.h:4,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/toolkit/SocketTk.h:4,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/RDMASocket.h:4,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:1:
Jun 11 17:00:39 vulcan beegfs-client[2572439]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:24: error: invalid application of ‘sizeof’ to incomplete type ‘char[]’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                        ^
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/minmax.h:20:28: note: in definition of macro ‘__typecheck’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    20 |         (!!(sizeof((typeof(x) *)1 == (typeof(y) *)1)))
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                            ^
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/minmax.h:36:31: note: in expansion of macro ‘__safe_cmp’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    36 |         __builtin_choose_expr(__safe_cmp(x, y), \
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                               ^~~~~~~~~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/minmax.h:45:25: note: in expansion of macro ‘__careful_cmp’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    45 | #define min(x, y)       __careful_cmp(x, y, <)
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                         ^~~~~~~~~~~~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |              ^~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: In file included from ./include/linux/list.h:8,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from ./include/linux/module.h:12,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/Common.h:4,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/toolkit/SocketTk.h:4,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/RDMASocket.h:4,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:1:
Jun 11 17:00:39 vulcan beegfs-client[2572439]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:24: error: invalid application of ‘sizeof’ to incomplete type ‘char[]’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                        ^
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/const.h:12:55: note: in definition of macro ‘__is_constexpr’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    12 |         (sizeof(int) == sizeof(*(8 ? ((void *)((long)(x) * 0l)) : (int *)8)))
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                                                       ^
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/minmax.h:26:39: note: in expansion of macro ‘__no_side_effects’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    26 |                 (__typecheck(x, y) && __no_side_effects(x, y))
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                                       ^~~~~~~~~~~~~~~~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/minmax.h:36:31: note: in expansion of macro ‘__safe_cmp’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    36 |         __builtin_choose_expr(__safe_cmp(x, y), \
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                               ^~~~~~~~~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: ./include/linux/minmax.h:45:25: note: in expansion of macro ‘__careful_cmp’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:    45 | #define min(x, y)       __careful_cmp(x, y, <)
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |                         ^~~~~~~~~~~~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:00:39 vulcan beegfs-client[2572439]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:00:39 vulcan beegfs-client[2572439]:       |              ^~~
Jun 11 17:00:39 vulcan beegfs-client[2572439]: In file included from ./include/linux/kernel.h:16,
Jun 11 17:00:39 vulcan beegfs-client[2572439]:                  from ./include/linux/list.h:9,
...skipping...
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |              ^~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:24: error: invalid application of ‘sizeof’ to incomplete type ‘char[]’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                        ^
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:28:40: note: in definition of macro ‘__cmp’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    28 | #define __cmp(x, y, op) ((x) op (y) ? (x) : (y))
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                                        ^
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:45:25: note: in expansion of macro ‘__careful_cmp’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    45 | #define min(x, y)       __careful_cmp(x, y, <)
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                         ^~~~~~~~~~~~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |              ^~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:24: error: invalid application of ‘sizeof’ to incomplete type ‘char[]’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                        ^
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:31:24: note: in definition of macro ‘__cmp_once’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    31 |                 typeof(x) unique_x = (x);               \
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                        ^
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:45:25: note: in expansion of macro ‘__careful_cmp’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    45 | #define min(x, y)       __careful_cmp(x, y, <)
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                         ^~~~~~~~~~~~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |              ^~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:24: error: invalid application of ‘sizeof’ to incomplete type ‘char[]’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                        ^
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:31:39: note: in definition of macro ‘__cmp_once’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    31 |                 typeof(x) unique_x = (x);               \
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                                       ^
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:45:25: note: in expansion of macro ‘__careful_cmp’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    45 | #define min(x, y)       __careful_cmp(x, y, <)
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                         ^~~~~~~~~~~~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |              ^~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:36:9: error: first argument to ‘__builtin_choose_expr’ not a constant
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    36 |         __builtin_choose_expr(__safe_cmp(x, y), \
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |         ^~~~~~~~~~~~~~~~~~~~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: ./include/linux/minmax.h:45:25: note: in expansion of macro ‘__careful_cmp’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:    45 | #define min(x, y)       __careful_cmp(x, y, <)
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |                         ^~~~~~~~~~~~~
Jun 11 17:03:10 vulcan beegfs-client[2577940]: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.c:123:14: note: in expansion of macro ‘min’
Jun 11 17:03:10 vulcan beegfs-client[2577940]:   123 |              min(sizeof(ifr.ifr_hwaddr.sa_data), (size_t) dev->addr_len) );
Jun 11 17:03:10 vulcan beegfs-client[2577940]:       |              ^~~
Jun 11 17:03:10 vulcan beegfs-client[2577018]: make[3]: *** [scripts/Makefile.build:297: /opt/beegfs/src/client/client_module_7/build/../source/common/net/sock/NetworkInterfaceCard.o] Error 1
Jun 11 17:03:10 vulcan beegfs-client[2577018]: make[3]: *** Waiting for unfinished jobs....
Jun 11 17:03:11 vulcan beegfs-client[2576774]: make[2]: *** [Makefile:1911: /opt/beegfs/src/client/client_module_7/build/../source] Error 2
Jun 11 17:03:11 vulcan beegfs-client[2576541]: make[1]: *** [Makefile:164: module] Error 2
Jun 11 17:03:11 vulcan beegfs-client[2576047]: make: *** [AutoRebuild.mk:34: auto_rebuild] Error 2
Jun 11 17:03:11 vulcan systemd[1]: beegfs-client.service: Main process exited, code=exited, status=2/INVALIDARGUMENT
Jun 11 17:03:11 vulcan systemd[1]: beegfs-client.service: Failed with result 'exit-code'.
Jun 11 17:03:11 vulcan systemd[1]: Failed to start Start BeeGFS Client.
Jun 11 17:03:11 vulcan systemd[1]: beegfs-client.service: Consumed 32.506s CPU time.

Any advice on how to fix this would be greatly appreciated! 

Best,

Peter

[Michael Krause]

Dear Peter,

You can try 7.3.4 maybe:

https://github.com/ThinkParQ/beegfs/compare/7.3.1...7.3.4#diff-553f030bcaecf6e1c2bd9c0b14bd1d888872c7a7ec198b6933f5c14c7d85f0c4

Since there is no real git history, there is also no information about
what this change is all about.

best of luck,
Michael

> --
> You received this message because you are subscribed to the Google
> Groups "beegfs-user" group.
> To unsubscribe from this group and stop receiving emails from it, send
> an email to fhgfs-user+...@googlegroups.com
> <mailto:fhgfs-user+...@googlegroups.com>.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/fhgfs-user/55d393e3-e3d9-41e4-9615-edc899288550n%40googlegroups.com <https://groups.google.com/d/msgid/fhgfs-user/55d393e3-e3d9-41e4-9615-edc899288550n%40googlegroups.com?utm_medium=email&utm_source=footer>.

[Tore H. Larsen]

Hi Peter,

      I recommend upgrading to 7.4.3. If so, read the caveats regarding 7.3.x to 7.4.x upgrades.

      Anyway, try the following

$ sudo apt install linux-headers-5.15.0-112-generic linux-headers-5.15.0-112

# sudo su -

# cd /etc/alternatives

# cd /etc/alternatives/ ; rm ofa_kernel_headers ; ln -sf /usr/src/ofa_kernel/x86_64/5.15.0-112-generic ofa_kernel_headers ; ll ofa_kernel_headers

# /etc/init.d/beegfs-client rebuild

      If you have different architecture, change x86_64 to aarch64 or whatever arch uname -m returns.

      Does that work for you?

      

--

Kind Regards / Mvh,

Tore H. Larsen

Chief Research Engineer HPC                                      Email:  to...@simula.no

Simula Research Laboratory - HPC department        Mobile: +47 918 33 670

Kristian Augusts gate 23, 0164 Oslo, Norway

--

You received this message because you are subscribed to the Google Groups "beegfs-user" group.

To unsubscribe from this group and stop receiving emails from it, send an email to fhgfs-user+...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/fhgfs-user/55d393e3-e3d9-41e4-9615-edc899288550n%40googlegroups.com.

[Peter van den Berg]

This seemed to have done the trick! Thanks a lot