Mallanox ConnectX-4 Lx problem with trex 2.48

53 views
Skip to first unread message

Wei Su

unread,
Nov 10, 2018, 8:25:18 PM11/10/18
to TRex Traffic Generator
I was not able to get trex working with ConnectX-4 Lx. From https://trex-tgn.cisco.com/trex/doc/trex_appendix_mellanox.html, it is mentioned to use OFED 4.3. However, I was not able to get it to work. The combination that works for me was trex 2.43, OFED 4.4. However, trex 2.43 does not have the latest astf support. I am looking to make 2.48 works with my setup.

---> Here is my environment:
rpm -q centos-release
centos-release-7-4.1708.el7.centos.x86_64

ofed_info -s
MLNX_OFED_LINUX-4.4-2.0.7.0:

lspci | grep Ethernet
01:00.0 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
01:00.1 Ethernet controller: Intel Corporation I350 Gigabit Network Connection (rev 01)
07:00.0 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]
07:00.1 Ethernet controller: Mellanox Technologies MT27710 Family [ConnectX-4 Lx]

--> I got the following error with trex 2.48
sudo ./t-rex-64 -i --astf
Killing Scapy server... Scapy server is killed
Starting Scapy server.... Scapy server is started
The ports are bound/configured.
Starting TRex v2.48 please wait ...
net_mlx5: port 0 verbs maximum priority: 8 expected 8/16
net_mlx5: probe of PCI device 0000:07:00.0 aborted after encountering an error: Unknown error -95
net_mlx5: port 0 verbs maximum priority: 8 expected 8/16
net_mlx5: probe of PCI device 0000:07:00.1 aborted after encountering an error: Unknown error -95
ERROR in DPDK map
Could not find requested interface 07:00.0

---> trying to fallback to software option. Even this is not working
sudo ./t-rex-64 -i --stl --software
[sudo] password for weisu:
Killing Scapy server... Scapy server is killed
Starting Scapy server.... Scapy server is started
The ports are bound/configured.
Starting TRex v2.48 please wait ...
net_mlx5: port 0 verbs maximum priority: 8 expected 8/16
net_mlx5: probe of PCI device 0000:07:00.0 aborted after encountering an error: Unknown error -95
net_mlx5: port 0 verbs maximum priority: 8 expected 8/16
net_mlx5: probe of PCI device 0000:07:00.1 aborted after encountering an error: Unknown error -95
ERROR in DPDK map
Could not find requested interface 07:00.0

hanoh haim

unread,
Nov 11, 2018, 2:29:41 AM11/11/18
to weis...@gmail.com, trex...@googlegroups.com
Hi Wei, 

This is what works for us for our CX-4 En  (it seems that it different than our documentation)

 
$ofed_info 
MLNX_OFED_LINUX-4.4-1.0.0.0 (OFED-4.4-1.0.0):


$ibv_devinfo 
hca_id: mlx5_0
        transport:                      InfiniBand (0)
        fw_ver:                         12.23.1000
        node_guid:                      248a:0703:0014:fc58
        sys_image_guid:                 248a:0703:0014:fc58
        vendor_id:                      0x02c9
        vendor_part_id:                 4115
        hw_ver:                         0x0
        board_id:                       MT_2150110033
        phys_port_cnt:                  1
                port:   1
                        state:                  PORT_ACTIVE (4)
                        max_mtu:                4096 (5)
                        active_mtu:             4096 (5)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00
                        link_layer:             Ethernet

hca_id: mlx5_1
        transport:                      InfiniBand (0)
        fw_ver:                         12.23.1000
        node_guid:                      248a:0703:0014:fc59
        sys_image_guid:                 248a:0703:0014:fc58
        vendor_id:                      0x02c9
        vendor_part_id:                 4115
        hw_ver:                         0x0
        board_id:                       MT_2150110033
        phys_port_cnt:                  1
                port:   1
                        state:                  PORT_ACTIVE (4)
                        max_mtu:                4096 (5)
                        active_mtu:             4096 (5)
                        sm_lid:                 0
                        port_lid:               0
                        port_lmc:               0x00
                        link_layer:             Ethernet


$cat /etc/redhat-release 
CentOS Linux release 7.5.1804 (Core) 

in the CX-5 setup we have OFED 4.3.1 that match the documentation 

from here it seems both OFED 4.4 and 4.3 can work

Could you try the MLNX_OFED_LINUX-4.4-1.0.0.0 (OFED-4.4-1.0.0) ?


thanks,
Hanoh


--
You received this message because you are subscribed to the Google Groups "TRex Traffic Generator" group.
To unsubscribe from this group and stop receiving emails from it, send an email to trex-tgn+u...@googlegroups.com.
To post to this group, send email to trex...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/trex-tgn/d0515d5b-091d-4e78-a08c-2435ad2ccaba%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


--
Hanoh
Sent from my iPhone

Wei Su

unread,
Nov 12, 2018, 1:17:40 AM11/12/18
to TRex Traffic Generator
Thank you Hanoh for quick reply. Unfortunately, OFED-4.4-1.0.0.0 still does not work for me. 
Do you know why I cannot fall back to --software option? Is --software option meant to use linux kernel driver instead of DPDK?

Regards,
Wei
$ ofed_info -s
MLNX_OFED_LINUX-4.4-1.0.0.0:

$ ibv_devinfo
hca_id: mlx5_0
transport: InfiniBand (0)
fw_ver: 14.23.1020
node_guid: 248a:0703:00b7:5c16
sys_image_guid: 248a:0703:00b7:5c16
vendor_id: 0x02c9
vendor_part_id: 4117
hw_ver: 0x0
board_id: MT_2420110034
phys_port_cnt: 1
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet

hca_id: mlx5_1
transport: InfiniBand (0)
fw_ver: 14.23.1020
node_guid: 248a:0703:00b7:5c17
sys_image_guid: 248a:0703:00b7:5c16
vendor_id: 0x02c9
vendor_part_id: 4117
hw_ver: 0x0
board_id: MT_2420110034
phys_port_cnt: 1
port: 1
state: PORT_ACTIVE (4)
max_mtu: 4096 (5)
active_mtu: 1024 (3)
sm_lid: 0
port_lid: 0
port_lmc: 0x00
link_layer: Ethernet

$ sudo ./t-rex-64 -i --astf
Starting Scapy server.... Scapy server is started
The ports are bound/configured.
Starting  TRex v2.48 please wait  ...
net_mlx5: port 0 verbs maximum priority: 8 expected 8/16
net_mlx5: probe of PCI device 0000:07:00.0 aborted after encountering an error: Unknown error -95
net_mlx5: port 0 verbs maximum priority: 8 expected 8/16
net_mlx5: probe of PCI device 0000:07:00.1 aborted after encountering an error: Unknown error -95
ERROR in DPDK map
Could not find requested interface 07:00.0


hanoh haim

unread,
Nov 12, 2018, 1:21:30 AM11/12/18
to Wei Su, TRex Traffic Generator
It is a different FW and different card.
Suggest to contact Mellanox 

Thanks,
Hanoh


For more options, visit https://groups.google.com/d/optout.
Reply all
Reply to author
Forward
0 new messages