SWI Installing Troubles on Ubuntu 18.04

333 views
Skip to first unread message

markus...@gmail.com

unread,
Feb 21, 2019, 10:47:47 AM2/21/19
to zrlio-users
Hi guys,

I'm about to install softiwarp (branch dev-siw.mem_ext) on my local machine (ubutnu 18.04, kernel 4.15.0-45-generic) and I'm having some troubles during install.

When installing the userlib I'm getting 'configure: error: <infiniband/driver.h> not found.  Is libibverbs installed?' during './configure', while the package libibverbs-dev is installed.

Instead when inserting the kernel module with 'sudo insmod ./siw.ko' it fails with 'ERROR: could not insert module ./siw.ko: Unknown symbol in module'. The output of 'dmesg | tail' looks like the following:
➜ dmesg | tail        
[ 1600.778847] siw: Unknown symbol ib_register_device (err 0)
[ 1600.778882] siw: Unknown symbol ib_dispatch_event (err 0)
[ 1600.778932] siw: Unknown symbol ib_dealloc_device (err 0)
[ 1600.778961] siw: Unknown symbol ib_alloc_device (err 0)
[ 1606.977474] siw: Unknown symbol ib_sg_to_pages (err 0)
[ 1606.977541] siw: Unknown symbol ib_unregister_device (err 0)
[ 1606.977586] siw: Unknown symbol ib_register_device (err 0)
[ 1606.977638] siw: Unknown symbol ib_dispatch_event (err 0)
[ 1606.977717] siw: Unknown symbol ib_dealloc_device (err 0)
[ 1606.977758] siw: Unknown symbol ib_alloc_device (err 0)


Does anybody have an idea? I wouldreally appreciate your help! 

Thank you in advance! 


Cheers,
Markus 



Jonas Pfefferle1

unread,
Feb 22, 2019, 3:14:41 AM2/22/19
to markus...@gmail.com, zrlio-users

Hi Markus,

See inline.

Cheers,
Jonas


zrlio...@googlegroups.com wrote on 02/21/2019 04:47:47 PM:

> From: markus...@gmail.com


> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 02/21/2019 04:47 PM
> Subject: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com
>
> Hi guys,

>
> I'm about to install softiwarp (branch dev-siw.mem_ext) on my local
> machine (ubutnu 18.04, kernel 4.15.0-45-generic) and I'm having some
> troubles during install.


It might be that 4.15 does not work with this particular branch AFAIK only 4.13 has been tested.
We are in the process of upstreaming SIW to the Linux kernel, so if you don't shy away installing a new kernel
you can find the up to date version of SIW here:
https://github.com/zrlio/softiwarp-user-for-linux-rdma
and
https://github.com/zrlio/softiwarp-for-linux-rdma




>
> When installing the userlib I'm getting 'configure: error:
> <infiniband/driver.h> not found.  Is libibverbs installed?' during
> './configure', while the package libibverbs-dev is installed.

>
> Instead when inserting the kernel module with 'sudo insmod ./siw.ko'
> it fails with 'ERROR: could not insert module ./siw.ko: Unknown
> symbol in module'. The output of 'dmesg | tail' looks like the following:

> ➜ dmesg | tail        
> [ 1600.778847] siw: Unknown symbol ib_register_device (err 0)
> [ 1600.778882] siw: Unknown symbol ib_dispatch_event (err 0)
> [ 1600.778932] siw: Unknown symbol ib_dealloc_device (err 0)
> [ 1600.778961] siw: Unknown symbol ib_alloc_device (err 0)
> [ 1606.977474] siw: Unknown symbol ib_sg_to_pages (err 0)
> [ 1606.977541] siw: Unknown symbol ib_unregister_device (err 0)
> [ 1606.977586] siw: Unknown symbol ib_register_device (err 0)
> [ 1606.977638] siw: Unknown symbol ib_dispatch_event (err 0)
> [ 1606.977717] siw: Unknown symbol ib_dealloc_device (err 0)
> [ 1606.977758] siw: Unknown symbol ib_alloc_device (err 0)

Looks like the ib_core module is not loaded. Try running "modprobe rdma_ucm" it should load all the dependent modules. Check if ib_core is loaded otherwise load with "modprobe ib_core".



>
> Does anybody have an idea? I wouldreally appreciate your help! 
>
> Thank you in advance! 
>
>
> Cheers,

> Markus 

>
> --
> You received this message because you are subscribed to the Google
> Groups "zrlio-users" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to zrlio-users...@googlegroups.com.
> To post to this group, send email to zrlio...@googlegroups.com.
> Visit this group at https://groups.google.com/group/zrlio-users.
> To view this discussion on the web visit https://groups.google.com/
> d/msgid/zrlio-users/10e7bcb4-c354-47ea-9c62-3e53f37908c7%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.

markus...@gmail.com

unread,
Mar 5, 2019, 9:22:47 AM3/5/19
to zrlio-users
Hi Jonas,

Thank you so much for your answer. I finally sovled it downgrading my kernel to 4.13 and loading the modules you mentioned.

Now I'm having the problem of an empty device list. After the first successfull installation there were results in 'ibv_devices', but after a reboot they disappeared. siw is running. 

I tried also to copy the siw.driver file to /etc/libiverbs.d/. After that, 'ibv_devices' output is the following:
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libsiw-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libsiw-rdmav17.so: cannot open shared object file: No such file or directory
    device             node GUID
    ------          ----------------


Under  /sys/class/infiniband I have:
➜ ls -la /sys/class/infiniband/*
lrwxrwxrwx 1 root root 0 Mär  5 15:14 /sys/class/infiniband/siw_docker0 -> ../../devices/software-rdma-v2/infiniband/siw_docker0
lrwxrwxrwx 1 root root 0 Mär  5 15:14 /sys/class/infiniband/siw_lo -> ../../devices/software-rdma-v2/infiniband/siw_lo


Do you have any idea what is going wrong?


Best,
Markus

Jonas Pfefferle1

unread,
Mar 5, 2019, 9:49:39 AM3/5/19
to markus...@gmail.com, zrlio-users

Hi Markus,

Which userspace library are you using? It looks like you are using the one from softiwarp-user-for-linux-rdma?
https://github.com/zrlio/softiwarp-user-for-linux-rdma is only compatible to https://github.com/zrlio/softiwarp-for-linux-rdma
Otherwise you need to use the userlibrary provided in https://github.com/zrlio/softiwarp

Cheers,
Jonas

Inactive hide details for markus.aurich---03/05/2019 03:22:58 PM---Hi Jonas, Thank you so much for your answer. I finally sovlemarkus.aurich---03/05/2019 03:22:58 PM---Hi Jonas, Thank you so much for your answer. I finally sovled it downgrading my

markus...@gmail.com

unread,
Mar 5, 2019, 10:30:05 AM3/5/19
to zrlio-users
Hi Jonas,

Yes, I forgot to mention in the menatime I switched to the user lib from https://github.com/zrlio/softiwarp-user-for-linux-rdma.

When trying to install the user lib from https://github.com/zrlio/softiwarp I'm getting the following error as before when I was using kernel 4.15:
configure: error: <infiniband/driver.h> not found.  Is libibverbs installed?

So if you have no other idea, I'll go for building and installing the kernel from https://github.com/zrlio/softiwarp-for-linux-rdma. Which branch should I use?


Best,
Markus
To unsubscribe from this group and stop receiving emails from it, send an email to zrlio-users+unsubscribe@googlegroups.com.

Bernard Metzler

unread,
Mar 5, 2019, 11:07:08 AM3/5/19
to markus...@gmail.com, zrlio-users

Hi Markus,

sorry for the mess...

We are in the process of pushing things upstream. I see you switched
to siw-for-linux-rdma. Brave!

Please take the latest branch, which currently is siw-for-rdma-next-v5

Same for the user library, please clone from siw-user-for-linux-rdma.
Here, please take branch siw-for-rdma-next. When things are built
and installed (including the ib core!), let LD_LIBRARY_PATH
point to the location of the libs.

Unfortunately, with Linux upstream inclusion, we had to satisfy
the request that siw does not automatically attach to available
interfaces, but manually via rdma tools - some extension
of the netlink interface. So you'd need that as well if you
want to attach siw to available interfaces. This is part of
the iproute2 package, as being prepared for the next kernel.
You find a working version at
https://github.com/larrystevenwise/iproute2.git
Here use branch  wip/newlink-2019-01-07

If you have built from that as well, and if you have siw loaded,
you can use the following command to add siw to a given link 'en0':

sudo iproute2/rdma/rdma link add siw0 type siw netdev en0

you can delete links using 'rdma link delete siw0'.

Let me know if that all works out.

Sorry again for the mess. As said, we are in the process
of reworking for Linux kernel acceptance.

In a few months. things are hopefully easier, since
just there.

Thanks and best regards,
Bernard.



zrlio...@googlegroups.com wrote on 03/05/2019 16:30:05:

> From: markus...@gmail.com

> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 03/05/2019 16:30
> Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com

>
> Hi Jonas,


>
> Yes, I forgot to mention in the menatime I switched to the user lib from
> https://github.com/zrlio/softiwarp-user-for-linux-rdma.

>
> When trying to install the user lib from https://github.com/zrlio/softiwarp
> I'm getting the following error as before when I was using kernel 4.15:

> configure: error: <infiniband/driver.h> not found.  Is libibverbs installed?
>
> So if you have no other idea, I'll go for building and installing
> the kernel from https://github.com/zrlio/softiwarp-for-linux-rdma.
> Which branch should I use?

>
> Best,
> Markus
>
>
> Am Dienstag, 5. März 2019 15:49:39 UTC+1 schrieb Jonas Pfefferle1:

> Hi Markus,
>
> Which userspace library are you using? It looks like you are using
> the one from softiwarp-user-for-linux-rdma?
> https://github.com/zrlio/softiwarp-user-for-linux-rdma is only compatible to
> https://github.com/zrlio/softiwarp-for-linux-rdma
> Otherwise you need to use the userlibrary provided in https://
> github.com/zrlio/softiwarp
>
> Cheers,
> Jonas
>

> [image removed] markus.aurich---03/05/2019 03:22:58 PM---Hi Jonas,

> Thank you so much for your answer. I finally sovled it downgrading my
>
> From: markus...@gmail.com
> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 03/05/2019 03:22 PM
> Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com


>
>
>

> d/msgid/zrlio-users/737fb661-9b3a-47cc-bf7b-eddef7ce36a5%40googlegroups.com.


> For more options, visit https://groups.google.com/d/optout.

>
> --
> You received this message because you are subscribed to the Google
> Groups "zrlio-users" group.
> To unsubscribe from this group and stop receiving emails from it,

> send an email to zrlio-users...@googlegroups.com.
> To post to this group, send email to zrlio...@googlegroups.com.
> Visit this group at https://groups.google.com/group/zrlio-users.
> To view this discussion on the web visit https://groups.google.com/

> d/msgid/zrlio-users/50ec9f8b-32cf-4665-a061-b28a90bf7c9a%40googlegroups.com.

markus...@gmail.com

unread,
Mar 6, 2019, 11:24:38 AM3/6/19
to zrlio-users
Hi Bernard,

Many thanks four your detailed instructions! I was able to build and start the kernel successfully. Siw is running, the user library is built, LD_LIBRARY_PATH is set correctly. I'm having troubles with the iproute2 command. I built it with 'make', installed it with 'make install', but i have no clue how 'sudo iproute2/rdma/rdma link add siw0 type siw netdev en0
' could work out ... Obviously it gives me 'command not found'. Which step I am missing?


Best,
Markus

Bernard Metzler

unread,
Mar 7, 2019, 5:03:02 AM3/7/19
to markus...@gmail.com, zrlio-users

Hi Markus,



zrlio...@googlegroups.com wrote on 03/06/2019 17:24:38:

> From: markus...@gmail.com

> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 03/06/2019 17:24
> Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com

>
> Hi Bernard,


>
> Many thanks four your detailed instructions! I was able to build and
> start the kernel successfully. Siw is running, the user library is
> built, LD_LIBRARY_PATH is set correctly. I'm having troubles with
> the iproute2 command. I built it with 'make', installed it with
> 'make install', but i have no clue how 'sudo iproute2/rdma/rdma link
> add siw0 type siw netdev en0

> ' could work out ... Obviously it gives me 'command not found'.
> Which step I am missing?


Ha, probably I was not sufficiently clear on it: You shall go
to where you built your netlink-rdma stuff and run the command from
there. If you have cloned and built from Steve's repo into
<iproute2>, you'd find the command 'rdma' in the rdma subdir of
it. Just 'cd' to rdma and run './rdma link add ....' there.

Let me know if something is still broken!

Best,
Bernard.

> d/msgid/zrlio-users/ed1e0fb0-1c82-4515-b567-f5021f431581%40googlegroups.com.

markus...@gmail.com

unread,
Mar 7, 2019, 8:32:05 AM3/7/19
to zrlio-users
Hi Bernard,

Oh sorry, I was on the right path, but had a build error in iproute2 ... Now its solved and I could link it successfully. 

'ibv_devices' actually outputs some warnings and the list is still empty: 

libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb3-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb3-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx4-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx4-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libnes-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libnes-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libhns-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libhns-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/librxe-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/librxe-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libbnxt_re-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libbnxt_re-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libhfi1verbs-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libhfi1verbs-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libsiw-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libsiw-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx5-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx5-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libi40iw-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libi40iw-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libvmw_pvrdma-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libvmw_pvrdma-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmthca-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmthca-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libipathverbs-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libipathverbs-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb4-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb4-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libqedr-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libqedr-rdmav17.so: cannot open shared object file: No such file or directory
libibverbs: Warning: couldn't load driver '/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libocrdma-rdmav17.so': /home/monsjovis/softiwarp-user-for-linux-rdma/lib/libocrdma-rdmav17.so: cannot open shared object file: No such file or directory
    device             node GUID
    ------          ----------------

When I 'ls' the lib folder the files are suffixed with 'v22'. So is there maybe still a version incompatibility? How could I solve it? I took the userlib and kernel branches you proproned.


Best,
Markus

Bernard Metzler

unread,
Mar 7, 2019, 10:59:46 AM3/7/19
to markus...@gmail.com, zrlio-users
Hi Markus,

does your LD_LIBRARY_PATH point to the right dir?
Maybe in the end you are loading the old ib_verbs library,
which expects the old provider lib's.

In my build here I have

[bmt@spoke rdma-core]$ echo $LD_LIBRARY_PATH
/home/bmt/siw-next/rdma-core/build/lib:

That dir contains all libs, including the generic libibverbs
and librdmacm plus provider libs. Those are all at the same
version number here....


Cheers,
Bernard.

-----zrlio...@googlegroups.com wrote: -----

>To: "zrlio-users" <zrlio...@googlegroups.com>
>From: markus...@gmail.com
>Sent by: zrlio...@googlegroups.com
>Date: 03/07/2019 02:32PM
>Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
>
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libhfi1verbs-rdmav
>17.so':
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libhfi1verbs-rdmav1
>7.so: cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libsiw-rdmav17.so'
>:
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libsiw-rdmav17.so:
>cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx5-rdmav17.so
>':
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx5-rdmav17.so:
>cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libi40iw-rdmav17.s
>o':
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libi40iw-rdmav17.so
>: cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libvmw_pvrdma-rdma
>v17.so':
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libvmw_pvrdma-rdmav
>17.so: cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmthca-rdmav17.s
>o':
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmthca-rdmav17.so
>: cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libipathverbs-rdma
>v17.so':
>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libipathverbs-rdmav
>17.so: cannot open shared object file: No such file or directory
>libibverbs: Warning: couldn't load driver
>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb4-rdmav17.s
>d/msgid/zrlio-users/50ec9f8b-32cf-4665-a061-b28a90bf7c9a%40googlegrou
>ps.com.
>> > For more options, visit https://groups.google.com/d/optout.
>> --
>> You received this message because you are subscribed to the Google
>> Groups "zrlio-users" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to zrlio-users...@googlegroups.com.
>> To post to this group, send email to zrlio...@googlegroups.com.
>> Visit this group at https://groups.google.com/group/zrlio-users.
>> To view this discussion on the web visit https://groups.google.com/
>>
>d/msgid/zrlio-users/ed1e0fb0-1c82-4515-b567-f5021f431581%40googlegrou
>ps.com.
>> For more options, visit https://groups.google.com/d/optout.
>
> --
> You received this message because you are subscribed to the Google
>Groups "zrlio-users" group.
> To unsubscribe from this group and stop receiving emails from it,
>send an email to zrlio-users...@googlegroups.com.
> To post to this group, send email to zrlio...@googlegroups.com.
> Visit this group at https://groups.google.com/group/zrlio-users.
> To view this discussion on the web visit
>https://groups.google.com/d/msgid/zrlio-users/9a84a27c-2b51-47a1-9685
>-c8a9b6c47598%40googlegroups.com.

markus...@gmail.com

unread,
Mar 8, 2019, 12:46:37 PM3/8/19
to zrlio-users
Hi Bernard,

You were right. There was a typo in my LD_LIBRARY_PATH. It's working now! I'm so happy! Thank you so much!!


Best,
Markus

Bernard Metzler

unread,
Mar 10, 2019, 10:38:10 AM3/10/19
to markus...@gmail.com, zrlio-users

Hi Markus,

That's good news! And welcome to the softiwarp testing team ;)

Best,
Bernard.

> d/msgid/zrlio-users/0acc9f30-56e4-41c9-a30a-58181fb0512f%40googlegroups.com.

kson...@ku.edu.tr

unread,
Mar 27, 2019, 4:46:54 AM3/27/19
to zrlio-users
Hello,

I am having trouble installing the kernel module with Ubuntu 18.04, kernel 4.18.0-16-generic. The userlib installs without problem. Running make from the kernel folder (I am using the softiwarp-dev-siw.mem_ext branch) gives the following error:

make[1]: Entering directory '/usr/src/linux-headers-4.18.0-16-generic'
  CC [M]  /home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.o
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c: In function ‘kernel_peername’:
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:221:53: warning: passing argument 3 of ‘s->ops->getname’ makes integer from pointer without a cast [-Wint-conversion]
  return s->ops->getname(s, (struct sockaddr *)addr, &unused, 1);
                                                     ^
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:221:53: note: expected ‘int’ but argument is of type ‘int *’
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:221:9: error: too many arguments to function ‘s->ops->getname’
  return s->ops->getname(s, (struct sockaddr *)addr, &unused, 1);
         ^
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c: In function ‘kernel_localname’:
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:228:53: warning: passing argument 3 of ‘s->ops->getname’ makes integer from pointer without a cast [-Wint-conversion]
  return s->ops->getname(s, (struct sockaddr *)addr, &unused, 0);
                                                     ^
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:228:53: note: expected ‘int’ but argument is of type ‘int *’
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:228:9: error: too many arguments to function ‘s->ops->getname’
  return s->ops->getname(s, (struct sockaddr *)addr, &unused, 0);
         ^
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c: In function ‘kernel_bindconnect’:
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:1541:34: warning: passing argument 3 of ‘s->ops->getname’ makes integer from pointer without a cast [-Wint-conversion]
  err = s->ops->getname(s, laddr, &s_val, 0);
                                  ^
/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:1541:34: note: expected ‘int’ but argument is of type ‘int *’
/home/karim//softiwarp-dev-siw.mem_ext/kernel/siw_cm.c:1541:8: error: too many arguments to function ‘s->ops->getname’
  err = s->ops->getname(s, laddr, &s_val, 0);
        ^
scripts/Makefile.build:325: recipe for target '/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.o' failed
make[2]: *** [/home/karim/softiwarp-dev-siw.mem_ext/kernel/siw_cm.o] Error 1
Makefile:1534: recipe for target '_module_/home/karim/softiwarp-dev-siw.mem_ext/kernel' failed
make[1]: *** [_module_/home/karim/softiwarp-dev-siw.mem_ext/kernel] Error 2
make[1]: Leaving directory '/usr/src/linux-headers-4.18.0-16-generic'
Makefile:18: recipe for target 'modules' failed
make: *** [modules] Error 2


Is this kernel version not yet supported or did I do something wrong?

Thanks,
Karim

Bernard Metzler

unread,
Mar 27, 2019, 11:28:16 AM3/27/19
to kson...@ku.edu.tr, zrlio-users
Hi Karim,

We abandoned following kernel versions and are aiming for
upstream integration. We hope to be part of Linux kernel
at 5.2 latest.

You can probably fix that issue here 'by hand' with just
removing the extra parameter from the calls;

return s->ops->getname(s, (struct sockaddr *)addr, &unused, 1);
-->
return s->ops->getname(s, (struct sockaddr *)addr, 1);

and

err = s->ops->getname(s, laddr, &s_val, 0);
-->
err = s->ops->getname(s, laddr, 0);


... I already called that parameter 'unused' by then ;)

Let me know if further issues arise.


Alternatively, you may consider following the current siw
development for becoming upstream accepted. It would require to
install the latest kernel candidate from rdma-next:

complete kernel: https://github.com/zrlio/softiwarp-for-linux-rdma.git
(branch siw-for-rdma-next-v6)

and


rdma user libs: https://github.com/zrlio/softiwarp-user-for-linux-rdma.git
(branch siw-for-rdma-next)

But that would also require installing some other tool to
attach siw to network interfaces, as it is planned for the whole
rdma subsystem for the next kernel. Let me know if you
would prefer that.


Best regards,
Bernard.


-----zrlio...@googlegroups.com wrote: -----

>To: "zrlio-users" <zrlio...@googlegroups.com>
>From: kson...@ku.edu.tr
>Sent by: zrlio...@googlegroups.com
>Date: 03/27/2019 09:47AM
>o
>> >: cannot open shared object file: No such file or directory
>> >libibverbs: Warning: couldn't load driver
>>
>>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmlx4-rdmav17.s
>o
>> >: cannot open shared object file: No such file or directory
>> >libibverbs: Warning: couldn't load driver
>>
>>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libvmw_pvrdma-rdm
>a
>> >v17.so':
>>
>>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libvmw_pvrdma-rdma
>v
>> >17.so: cannot open shared object file: No such file or directory
>> >libibverbs: Warning: couldn't load driver
>>
>>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmthca-rdmav17.
>s
>> >o':
>>
>>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libmthca-rdmav17.s
>o
>> >: cannot open shared object file: No such file or directory
>> >libibverbs: Warning: couldn't load driver
>>
>>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libipathverbs-rdm
>a
>> >v17.so':
>>
>>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libipathverbs-rdma
>v
>> >17.so: cannot open shared object file: No such file or directory
>> >libibverbs: Warning: couldn't load driver
>>
>>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb4-rdmav17.
>s
>> >o':
>>
>>/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libcxgb4-rdmav17.s
>o
>> >: cannot open shared object file: No such file or directory
>> >libibverbs: Warning: couldn't load driver
>>
>>'/home/monsjovis/softiwarp-user-for-linux-rdma/lib/libqedr-rdmav17.s
>>d/msgid/zrlio-users/ed1e0fb0-1c82-4515-b567-f5021f431581%40googlegro
>u
>> >ps.com.
>> >> For more options, visit https://groups.google.com/d/optout.
>> >
>> > --
>> > You received this message because you are subscribed to the
>Google
>> >Groups "zrlio-users" group.
>> > To unsubscribe from this group and stop receiving emails from it,
>
>> >send an email to zrlio-users...@googlegroups.com.
>> > To post to this group, send email to zrlio...@googlegroups.com.
>> > Visit this group at https://groups.google.com/group/zrlio-users.
>> > To view this discussion on the web visit
>>
>>https://groups.google.com/d/msgid/zrlio-users/9a84a27c-2b51-47a1-968
>5
>> >-c8a9b6c47598%40googlegroups.com.
>> > For more options, visit https://groups.google.com/d/optout.
>> >
>
>> --
>> You received this message because you are subscribed to the Google
>> Groups "zrlio-users" group.
>> To unsubscribe from this group and stop receiving emails from it,
>> send an email to zrlio-users...@googlegroups.com.
>> To post to this group, send email to zrlio...@googlegroups.com.
>> Visit this group at https://groups.google.com/group/zrlio-users.
>> To view this discussion on the web visit https://groups.google.com/
>>
>d/msgid/zrlio-users/0acc9f30-56e4-41c9-a30a-58181fb0512f%40googlegrou
>ps.com.
>> For more options, visit https://groups.google.com/d/optout.
>
> --
> You received this message because you are subscribed to the Google
>Groups "zrlio-users" group.
> To unsubscribe from this group and stop receiving emails from it,
>send an email to zrlio-users...@googlegroups.com.
> To post to this group, send email to zrlio...@googlegroups.com.
> Visit this group at https://groups.google.com/group/zrlio-users.
> To view this discussion on the web visit
>https://groups.google.com/d/msgid/zrlio-users/9fdbdf04-e73f-4005-ad2b
>-52885f339c97%40googlegroups.com.
Reply all
Reply to author
Forward
0 new messages