No cable connected with Bluefield DPUs on r7525

[Shixiong Qi]

Hello,

We plan to implement inter-node RDMA communication using Bluefield-2 DPUs on the r7525 node, but we've observed that the DPU ports display “NO-CARRIER” (indicating no cable is connected). The p0 and p1 ports correspond to the two DPU ports:

4: p0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq master ovs-system state DOWN group default qlen 1000
    link/ether b8:3f:d2:b9:22:60 brd ff:ff:ff:ff:ff:ff
    altname enp3s0f0np0
5: p1: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc mq state DOWN group default qlen 1000
    link/ether b8:3f:d2:b9:22:61 brd ff:ff:ff:ff:ff:ff

    altname enp3s0f1np1 

Could you please confirm the physical link status of these nodes in the cluster? If any disconnections are found, please plug the network cable into the DPU device. We are working on the EuroSys AE and facing a deadline. your assistance is greatly appreciated.

This is the experimental status page:
https://www.cloudlab.us/status.php?uuid=dd9c7abf-8b53-11f0-bc80-e4434b2381fc

Thanks,

Shixiong

[Mike Hibler]

It looks like two of your nodes are using the 25Gb NICs instead of the 100Gb
NICSs. You should re-instantiate your experiment and specify a link speed
of 100Gb in the advanced options.

Note that an interface must be specified in your topology (i.e., be part of
a link or lan) or else the interface will be disabled at the switch.

> --
> You received this message because you are subscribed to the Google Groups
> "cloudlab-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to cloudlab-user...@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/cloudlab-users/
> 5ac715c6-e5ab-4280-84fd-8ce60f6ba228n%40googlegroups.com.