Intel E810-C NIC cannot get past 128 Gbps

[Felipe Arturo Polanco]

Hi,

We have an Intel E810-C NIC and we are having challenges to get past ~121 Gbps when transmitting on both ports.

It is a PCIe 4.0 x16 card, that should give 31.51 GB/s (252.08gbps), still we get around 60.5 Gbps per port when both are Transmitting, if Transmitting using only one port we get 100Gbps as expected.

Any idea what could cause this? Test screenshot below.

[Besart Dollma]

Hi Felipe, 

As you can see, the queue is full and the NIC is buffering the packets. This causes back pressure and raises the CPU Util. 

Try to run with more cores or use --queue-drop.

Thank you

[Chris Merkel]

Did you turn on bifurcation of the PCIe slot?  The product brief calls this out for full BW.

Bus Type/Bus Width PCIe 4.0 x16 Note: full 200Gbps performance requires PCIe slot bifurcation enabled in the system BIOS.

https://newsroom.intel.com/wp-content/uploads/sites/11/2021/04/Intel-Ethernet-Adapter-e810-2cqda2-Product-Brief-590434.pdf

[redr...@gmail.com]

Hi,

Now could you achieve 200Gbps full bandwidth with PCIe slot bifurcation enabled?

[hanoh haim]

Hi, 

I would reduce the speed up to the point that you don't have ierrors or queue-full then I would add more cores to see if it get better. 

E810 is working in software mode (does not support hardware) so it is expected to be slower than Mellanox- CX5/6 

the PCIe is not the only limitation 

Thanks

Hanoh

--
You received this message because you are subscribed to the Google Groups "TRex Traffic Generator" group.
To unsubscribe from this group and stop receiving emails from it, send an email to trex-tgn+u...@googlegroups.com.
To view this discussion on the web visit https://groups.google.com/d/msgid/trex-tgn/cc6506d9-1559-4fad-80c3-8adb19d741c9n%40googlegroups.com.

[Alex K]

Make sure you have the E810-2CQDA2 NIC. This is the model I use to get 200Gbps in total from both ports.

https://ark.intel.com/content/www/us/en/ark/products/210969/intel-ethernet-network-adapter-e8102cqda2.html

I'm  not aware of other E810 models supporting 200Gbps, but feel free to double check if other models in that list specifically mention 200Gbps.

https://ark.intel.com/content/www/us/en/ark/products/series/184846/100gbe-intel-ethernet-network-adapter-e810.html

[Hubert Hans]

The CPU Ultilisation is at 99,xx%

[Alex K]

1. What packets size? 
2. Do you want to give me your console commands/configuration files to rerun your tests on my system? I can check the performance and report it back

[Alex K]