Saturday, August 25, 2018

DAE run into Cisco Catalyst 9500-48Y4C bug (?) with 1G SFPs 16.8.1a

Trying to work this through a TAC case but that will take some time.

Wonder if anyone else is running into this one ...

I have a rebuilt campus distribution based on the 9500 with 5 x 48Y4Cs and 2 x 32Cs. Everything is OK so far except for an issue where some links quietly fail and stop passing traffic.

At first I assumed it was older or failing SFPs but the same failure conditions have happened across multiple 9500s now and the far end has been a mix of different switches (3560X 3850 etc).

The nature of the failure is: 1. The link quietly stops passing traffic without a link state change 2. On both sides of the link TX counters have a trickle but RX counters are zero 3. No CDP neighbor information etc makes it through 4. Reseating or swapping the SFP on the far end (non- 9500) of the link has no effect 5. Reseating the SFP on the 9500 restores the link 6. So far this has happened exactly like this on 3 different 9500s and 7 different links 7. In every case this has been when a 1G SFP was in use (no failures for 10G or 40G links so far)

Across the 5 x 9500s we have for distribution we seem to have a link fail in this way every 1 to 3 days. So far it's been a different link each time except for one which has been our only repeat offender (swapped out optics on both ends of this one and got OTDR shots of the fiber to make sure it is good so waiting to see if it happens again).

Most of or buildings can be brought up at 10G but we do have a good number (50 or so) that can't either because of older switches or (unfortunately) old MM fiber. Before you ask the failure has happened on both MM and SM runs so far so that's likely not the issue.



No comments:

Post a Comment