Friday, April 12, 2019

Key features to acheive 2Gbit/s single communication stream with LACP

Hey there,

i have here a rumor (it has already been proved working) that it is possible to acheive a higher throughput for a single data stream just with LACP configuration. For example with 2x 1 GBit/s Ports transfer one file with more than 120 MB/s.

There were 3 admins that proved me it is working, but failed to get it working on my setup. The main problem is, they can not tell me where i have to look for or at. I have digged really a long time into this topic for years now and now i am trying to get some help here. So far some basics that might cover my issue:

  • smb3 introduced multipath / multichannel data transfer when using multiple nics with multiple ip addresses. But this is not what i want
  • LACP has different revisions and implementations. There are at least two different functionalities known as TRUNK MODE and ADAPTER TEAMING. Only the last option seems to be suitable for my needs.
  • there are several load balancing algorithms for LACP. Depending on the device you need to choose a specific one to get it working. Some call it Layer2 and Layer3 or MAC and IP with Source and Destination address calculation?!.

So far i wasn't able to acheive 2 GBit/s with a single stream at my setup / network / lab.

More Details

  • Bandwidth is tested with iperf
  • OS used is windows server 2012 R2
  • Hardware used are Fujitsu RX200 S8, Intel MFSYS25, QNAP TS-563 Pro, some other Servers/workstations with Intel DUAL Server port Adapters
  • Switches i tried are hp officeconnect 1920s and netgear prosafe GS724T
  • german short overview about htis topic and screenshots from other admins transfer speeds https://docdro.id/5VUAeXS

Windows config

  • Teaming = LACP
  • Load Balancing = Dynamic
  • Standby - none

Switch Config

  • LACP Dynamic for NAS and windows servers
  • LACP Static for ESXi hosts

ESXi config

  • switch type = vSphere distributed Switch
  • nic type = vmxnet3
  • Load Balancing = IP Hash
  • Failover = status only
  • notify switches = yes
  • fallback = no

NAS config

  • teaming = 802.3ad
  • Load Balancing = Dynamic
  • Standby = no
  • QNAP claims that their device can not acheive more than 1 GBit/s on a single stream. Other examples that are working were always with synologie diskstations (2x cases sof ar)

My goal is to to acheive more throughput for backups between multiple esxi hosts to our backup-server and increase bandwidth between multiple hosts. I have a second project running with infiniband, but thats not functional for now :-/. And i really want to know why they can what i can not do.



No comments:

Post a Comment