Hi Markus,
See inline.
Cheers,
Jonas
zrlio...@googlegroups.com wrote on 02/21/2019 04:47:47 PM:
> From: markus...@gmail.com
> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 02/21/2019 04:47 PM
> Subject: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com
>
> Hi guys,
>
> I'm about to install softiwarp (branch dev-siw.mem_ext) on my local
> machine (ubutnu 18.04, kernel 4.15.0-45-generic) and I'm having some
> troubles during install.
It might be that 4.15 does not work with this particular branch AFAIK only 4.13 has been tested.
We are in the process of upstreaming SIW to the Linux kernel, so if you don't shy away installing a new kernel
you can find the up to date version of SIW here:
https://github.com/zrlio/softiwarp-user-for-linux-rdma
and
https://github.com/zrlio/softiwarp-for-linux-rdma
>
> When installing the userlib I'm getting 'configure: error:
> <infiniband/driver.h> not found. Is libibverbs installed?' during
> './configure', while the package libibverbs-dev is installed.
>
> Instead when inserting the kernel module with 'sudo insmod ./siw.ko'
> it fails with 'ERROR: could not insert module ./siw.ko: Unknown
> symbol in module'. The output of 'dmesg | tail' looks like the following:
> ➜ dmesg | tail
> [ 1600.778847] siw: Unknown symbol ib_register_device (err 0)
> [ 1600.778882] siw: Unknown symbol ib_dispatch_event (err 0)
> [ 1600.778932] siw: Unknown symbol ib_dealloc_device (err 0)
> [ 1600.778961] siw: Unknown symbol ib_alloc_device (err 0)
> [ 1606.977474] siw: Unknown symbol ib_sg_to_pages (err 0)
> [ 1606.977541] siw: Unknown symbol ib_unregister_device (err 0)
> [ 1606.977586] siw: Unknown symbol ib_register_device (err 0)
> [ 1606.977638] siw: Unknown symbol ib_dispatch_event (err 0)
> [ 1606.977717] siw: Unknown symbol ib_dealloc_device (err 0)
> [ 1606.977758] siw: Unknown symbol ib_alloc_device (err 0)
Looks like the ib_core module is not loaded. Try running "modprobe rdma_ucm" it should load all the dependent modules. Check if ib_core is loaded otherwise load with "modprobe ib_core".
>
> Does anybody have an idea? I wouldreally appreciate your help!
>
> Thank you in advance!
>
>
> Cheers,
> Markus
>
> --
> You received this message because you are subscribed to the Google
> Groups "zrlio-users" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to zrlio-users...@googlegroups.com.
> To post to this group, send email to zrlio...@googlegroups.com.
> Visit this group at https://groups.google.com/group/zrlio-users.
> To view this discussion on the web visit https://groups.google.com/
> d/msgid/zrlio-users/10e7bcb4-c354-47ea-9c62-3e53f37908c7%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
Hi Markus,
Which userspace library are you using? It looks like you are using the one from softiwarp-user-for-linux-rdma?
https://github.com/zrlio/softiwarp-user-for-linux-rdma is only compatible to https://github.com/zrlio/softiwarp-for-linux-rdma
Otherwise you need to use the userlibrary provided in https://github.com/zrlio/softiwarp
Cheers,
Jonas
markus.aurich---03/05/2019 03:22:58 PM---Hi Jonas, Thank you so much for your answer. I finally sovled it downgrading my
To view this discussion on the web visit https://groups.google.com/d/msgid/zrlio-users/737fb661-9b3a-47cc-bf7b-eddef7ce36a5%40googlegroups.com.
To unsubscribe from this group and stop receiving emails from it, send an email to zrlio-users+unsubscribe@googlegroups.com.
Hi Markus,
sorry for the mess...
We are in the process of pushing things upstream. I see you switched
to siw-for-linux-rdma. Brave!
Please take the latest branch, which currently is siw-for-rdma-next-v5
Same for the user library, please clone from siw-user-for-linux-rdma.
Here, please take branch siw-for-rdma-next. When things are built
and installed (including the ib core!), let LD_LIBRARY_PATH
point to the location of the libs.
Unfortunately, with Linux upstream inclusion, we had to satisfy
the request that siw does not automatically attach to available
interfaces, but manually via rdma tools - some extension
of the netlink interface. So you'd need that as well if you
want to attach siw to available interfaces. This is part of
the iproute2 package, as being prepared for the next kernel.
You find a working version at
https://github.com/larrystevenwise/iproute2.git
Here use branch wip/newlink-2019-01-07
If you have built from that as well, and if you have siw loaded,
you can use the following command to add siw to a given link 'en0':
sudo iproute2/rdma/rdma link add siw0 type siw netdev en0
you can delete links using 'rdma link delete siw0'.
Let me know if that all works out.
Sorry again for the mess. As said, we are in the process
of reworking for Linux kernel acceptance.
In a few months. things are hopefully easier, since
just there.
Thanks and best regards,
Bernard.
zrlio...@googlegroups.com wrote on 03/05/2019 16:30:05:
> From: markus...@gmail.com
> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 03/05/2019 16:30
> Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com
>
> Hi Jonas,
>
> Yes, I forgot to mention in the menatime I switched to the user lib from
> https://github.com/zrlio/softiwarp-user-for-linux-rdma.
>
> When trying to install the user lib from https://github.com/zrlio/softiwarp
> I'm getting the following error as before when I was using kernel 4.15:
> configure: error: <infiniband/driver.h> not found. Is libibverbs installed?
>
> So if you have no other idea, I'll go for building and installing
> the kernel from https://github.com/zrlio/softiwarp-for-linux-rdma.
> Which branch should I use?
>
> Best,
> Markus
>
>
> Am Dienstag, 5. März 2019 15:49:39 UTC+1 schrieb Jonas Pfefferle1:
> Hi Markus,
>
> Which userspace library are you using? It looks like you are using
> the one from softiwarp-user-for-linux-rdma?
> https://github.com/zrlio/softiwarp-user-for-linux-rdma is only compatible to
> https://github.com/zrlio/softiwarp-for-linux-rdma
> Otherwise you need to use the userlibrary provided in https://
> github.com/zrlio/softiwarp
>
> Cheers,
> Jonas
>
> [image removed] markus.aurich---03/05/2019 03:22:58 PM---Hi Jonas,
> Thank you so much for your answer. I finally sovled it downgrading my
>
> From: markus...@gmail.com
> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 03/05/2019 03:22 PM
> Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com
>
>
>
> d/msgid/zrlio-users/737fb661-9b3a-47cc-bf7b-eddef7ce36a5%40googlegroups.com.
> For more options, visit https://groups.google.com/d/optout.
>
> --
> You received this message because you are subscribed to the Google
> Groups "zrlio-users" group.
> To unsubscribe from this group and stop receiving emails from it,
> send an email to zrlio-users...@googlegroups.com.
> To post to this group, send email to zrlio...@googlegroups.com.
> Visit this group at https://groups.google.com/group/zrlio-users.
> To view this discussion on the web visit https://groups.google.com/
> d/msgid/zrlio-users/50ec9f8b-32cf-4665-a061-b28a90bf7c9a%40googlegroups.com.
Hi Markus,
zrlio...@googlegroups.com wrote on 03/06/2019 17:24:38:
> From: markus...@gmail.com
> To: "zrlio-users" <zrlio...@googlegroups.com>
> Date: 03/06/2019 17:24
> Subject: Re: [zrlio-users] SWI Installing Troubles on Ubuntu 18.04
> Sent by: zrlio...@googlegroups.com
>
> Hi Bernard,
>
> Many thanks four your detailed instructions! I was able to build and
> start the kernel successfully. Siw is running, the user library is
> built, LD_LIBRARY_PATH is set correctly. I'm having troubles with
> the iproute2 command. I built it with 'make', installed it with
> 'make install', but i have no clue how 'sudo iproute2/rdma/rdma link
> add siw0 type siw netdev en0
> ' could work out ... Obviously it gives me 'command not found'.
> Which step I am missing?
Ha, probably I was not sufficiently clear on it: You shall go
to where you built your netlink-rdma stuff and run the command from
there. If you have cloned and built from Steve's repo into
<iproute2>, you'd find the command 'rdma' in the rdma subdir of
it. Just 'cd' to rdma and run './rdma link add ....' there.
Let me know if something is still broken!
Best,
Bernard.
> d/msgid/zrlio-users/ed1e0fb0-1c82-4515-b567-f5021f431581%40googlegroups.com.
Hi Markus,
That's good news! And welcome to the softiwarp testing team ;)
Best,
Bernard.
> d/msgid/zrlio-users/0acc9f30-56e4-41c9-a30a-58181fb0512f%40googlegroups.com.