Monday, November 8, 2021

I just spent 9 hours troubleshooting a bad power cable.

I had a stack of switches that has been online for a couple weeks now, but has been acting wonky the entire time. They were up, and passing traffic, but just acting . . . wonky.

SFP ports sometimes wouldn't work. Unplug the SFP itself and plug them back into a DIFFERENT port, then plug them into the original port and they'd work again. Couldn't get both sides of a LAG back to the core to come up. Either one independently, but not both. UDLD would report all kinds of errors on known good fiber. Spent hours shining light, swapping pairs, swapping patches, swapping optics, taking the entire stack back to our workbench and plugging it directly into the core, taking it back to its home and plug it back in and shit that worked PERFECTLY on the bench suddenly won't work.

Sometimes clients would negotiate at 10mbit, 100mbit, or 1gbit. Using the internal cable test utility was returning all sorts of random crazy results, even on cables that we tested with a Fluke Net Tool and all passed easily. PoE would sometimes work and sometimes not. Reboot the switch and PoE would work, reboot it again and they wouldn't.

NINE HOURS LATER we finally called the electrician over because I was about to loose my mind.

We had 180v on the ground.

He replaced the extension, and all the problems went away.

Motherfucking Layer 0 fucked me in the ass today.



No comments:

Post a Comment