Throughput issues with recently installed Gig Ethernet card - Dell PowerEdge T320, Proxmox/Debian, Broadcom NetXtreme BCM5722

Hi all,

I recently added a node to a Proxmox cluster and was setting up a dedicated server <-> server ethernet connection with some spare NICs but I am getting significant throughput issues on the new card.

I am suspicious of the NIC I installed in the T320 and NOT of the NIC in the node because the node's NIC is integrated to the motherboard.

I installed a Broadcom Limited NetXtreme BCM5722 Gigabit Ethernet in a PCIe slot and ran iperf3 tests against that connection. I'm getting ~ 1/10th of what I should be getting.

root@Node:~# iperf3 -c 10.0.0.2 -f K Connecting to host 10.0.0.2, port 5201 [ 5] local 10.0.0.1 port 55678 connected to 10.0.0.2 port 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 11.7 MBytes 11995 KBytes/sec 0 103 KBytes [ 5] 1.00-2.00 sec 11.2 MBytes 11454 KBytes/sec 0 112 KBytes [ 5] 2.00-3.00 sec 11.4 MBytes 11709 KBytes/sec 0 117 KBytes [ 5] 3.00-4.00 sec 11.2 MBytes 11454 KBytes/sec 0 117 KBytes [ 5] 4.00-5.00 sec 11.2 MBytes 11454 KBytes/sec 0 117 KBytes [ 5] 5.00-6.00 sec 11.2 MBytes 11454 KBytes/sec 0 117 KBytes [ 5] 6.00-7.00 sec 11.2 MBytes 11454 KBytes/sec 0 117 KBytes [ 5] 7.00-8.00 sec 11.2 MBytes 11454 KBytes/sec 0 117 KBytes [ 5] 8.00-9.00 sec 11.2 MBytes 11454 KBytes/sec 0 117 KBytes [ 5] 9.00-10.00 sec 11.4 MBytes 11708 KBytes/sec 0 117 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 113 MBytes 11559 KBytes/sec 0 sender [ 5] 0.00-10.01 sec 112 MBytes 11491 KBytes/sec receiver iperf Done. 

Do I need to install drivers for this new card? How?

There are 2 x Broadcom Limited NetXtreme BCM5720 Gigabit Ethernet PCIe already in the server and working perfectly fine. Here's an iperf3 test of the other NICs:

root@Server:~# iperf3 -s -f K ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Accepted connection from 192.168.1.24, port 41744 [ 5] local 192.168.1.129 port 5201 connected to 192.168.1.24 port 41746 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 110 MBytes 112945 KBytes/sec [ 5] 1.00-2.00 sec 111 MBytes 113185 KBytes/sec [ 5] 2.00-3.00 sec 111 MBytes 113171 KBytes/sec [ 5] 3.00-4.00 sec 110 MBytes 113107 KBytes/sec [ 5] 4.00-5.00 sec 111 MBytes 113154 KBytes/sec [ 5] 5.00-6.00 sec 111 MBytes 113193 KBytes/sec [ 5] 6.00-7.00 sec 110 MBytes 113137 KBytes/sec [ 5] 7.00-8.00 sec 110 MBytes 113026 KBytes/sec [ 5] 8.00-9.00 sec 110 MBytes 113006 KBytes/sec [ 5] 9.00-10.00 sec 111 MBytes 113192 KBytes/sec [ 5] 10.00-10.00 sec 276 KBytes 111679 KBytes/sec - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.00 sec 1.08 GBytes 113111 KBytes/sec receiver 

I found these: https://www.broadcom.com/support/download-search?pg=&pf=Ethernet+Network+Adapters&pn=&pa=&po=&dk=&pl=

What am I doing wrong here?