Sunday, September 27, 2020

LAG dropping to 10 FDX

Greetings,

I hope I can explain this well enough to make sense. So the TLDR would be when I make a second LAG the switch goes from reporting the default hidden 1000 FDX to 10 FDX for how ever many ports are in the uplink LAG.

So here is the full story. I mess with Unifi all the time. My job at my MSP is to maintain all our clients Unifi stuff and I have a dozen or so Unifi devices at home because why not. I would like to think I am not a noob at this stuff.

We recently finally went ahead and bought all new replacement Unifi switches to run our shop. The contestants are:

Software Controller - 6.0.23 - running on a linux VM

US-48-G1 - 4.3.21.11325 - as the main switch, what we will be pluging into for all our workstations and printers and whatnot.

USW-24-G2 - 4.3.21.11325 - as our server switch, what we will plug in our VM server and our 3 synology diskstations.

USW-16-PoE - 4.3.21.11325 - as our PoE switch for our new VOIP phones, and an ATA and our UAP-AC-HD - 4.3.21.11325.

US-8 - 4.3.21.11325 - for our workbench switch, to plug in any client systems we have to work on.

So because we can we want to LAG the USW-24-G2 and USW-16-PoE to the US-48-G1. So I set the last 6 ports on the 24 to LAG, then set the 37-42 ports on the 48 to LAG. Alls good, 6 uplink ports, all green, yay. Do the same for the 16, last 6 on the 16, 43-48 on the 48. All good, 6 uplink, all green.

So the 48 has 2 6 port LAG's going, reporting 1000 FDX on all 12, everything good.

Now, we have our VM Server with 4 ports, and each of the 3 synology diskstations have 2 ports. LAG's all around for them too. Here's where the WTF starts. As soon as I make a second LAG group on the 24, the 6 uplink ports on the 24 report as 10 FDX and show amber on the controller. The Status also goes to CONNECTED | 60 FDX. It still shows 1000 FDX on the 48 though. If I remove the second LAG it goes back to green and the 60 FDX goes away. If I change the group to 4 ports, it will report 40 FDX. One of the diskstations we are not actively using at the moment and when I set it to use 802.3ad dynamic and create a LAG for the 2 ports it is connected to, it also reports on the controller as 10 FDX on both ports. Inside the diskstation it is still reporting a 2000 FDX connection. Speed tests also point to that there is more than a 10 meg connection. So I do believe it is not actually running at 10, but just showing in the controller as 10. I will have to double check when I am in the office on Monday what the LED's say on the switches. If I am remembering correctly they were still green, but I have tried sooooo many different things, I can't claim that for certain.

I feel like I have tried everything to create any different kind of situation. I will try my hardest to list everything I tried...

Created the same setup on the PoE and had the same 60 FDX connection.

Tried to force 1000 FDX on all the ports in question, don't remember exactly what happened, either disconnected all together or went to 10.

Have forgotten the switch and readopt and resetup.

As a precaution, I have a single patch cable from the 48 to the 24, 16 and 8. I have disable the 3 ports they are plugged into from the 48 most of the time, but have reenabled them when needed to restore connectivity if anything didn't provision right. So I tried disabling the 6 uplink ports and using the single connection and setting multiple LAG's and the same thing happens on the 2 ports for the diskstation. It will go to amber and report as 10 FDX for both ports, but show 2000 FDX in the diskstation.

Have dropped the 6 to 4 and enabled the 2 for the diskstation, same result.

Have set it up as it ultimately should be and restarted everything. Both sequentially and from the UPS they are all 3 connected to.

I am sure there have been a couple other things that I have tried in desperation, but the second there are 2 LAG's enabled then it reports them as 10 FDX. Any ideas why or what I may be doing wrong?



No comments:

Post a Comment