Special hardware setup request for sm220u nodes

[Ashfaqur Rahaman]

Hi,

I have two sm220u nodes reserved. My experiments require 2x100 Gbps CX-6 NICs on the same CPU socket/NUMA node.

I have found that two 100 Gbps CX-6 NICs are available on the sm220u nodes. But they are installed on two different CPU sockets/NUMA nodes. Is it possible to use both of the NICs for my experiment? And is it possible to slot both of the NICs on the same CPU socket/NUMA node in one of the nodes?

Here is a link to my experiment: https://www.cloudlab.us/status.php?uuid=13dff0fc-c978-4f98-a0e0-51f0166829a3

Thank you.

Kind regards,

Ashfaq

[Mike Hibler]

Only one of the dual-port NICs is connected to a Cloudlab switch:

/0/103/2/0 ens2f0np0 network MT2892 Family [ConnectX-6 Dx]
/0/103/2/0.1 ens2f1np1 network MT2892 Family [ConnectX-6 Dx]

Ports on the other dual-port NIC are either not connected or connected to a
switch outside of Cloudlab control. If the current two ports are not sufficient
it is unlikely that the second NIC can be rewired.

> --
> You received this message because you are subscribed to the Google Groups
> "cloudlab-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an email
> to cloudlab-user...@googlegroups.com.
> To view this discussion visit https://groups.google.com/d/msgid/cloudlab-users/
> ae807ea4-93da-47ae-8f7a-100d259c9e2fn%40googlegroups.com.

[Aleksander Maricq]

Hi Ashfaq,

I've already been talking to Ryan about this.  It would be a lot easier all-around if there were any hardware types at Utah that supported PCIe Global Atomics, because then I could just do the work myself.  Could you look into some of the hardware types there (specifically the d7615s) and let me know if any of those would meet your requirements?

Thanks,

 - Aleks

[Ashfaqur Rahaman]

Hi Aleks,

I will checkout d7615 node and let you know if it works for me.

Thank you.

Kind regards,

Ashfaq