Wednesday, October 14, 2020

Network Latency

Hi all, small and lowly sysadmin here (admins- delete if not allowed)

The company I work for is having some major issues and frankly I am ready to jump ship, otherwise I think they're going to fire the entire IT Ops Team.

Here's the problem - In our file storage, we experince high latency (500ms to 2400ms) unless we reboot our ESX Hosts, which things calm down for a while. We havn't been able to figure out what is causing this yet. However, we have had a few 'odd' events that have happened in the past few months or so (they could be related, but it could all be totally random):

  • The company fired our VP of IT
  • Had a major wind storm that knocked power out for a few days, but out building was experincing brownouts. Out back up generators failed and so all of the IT racks were plugged into main power which were affected by the brown outs
  • We were technically on two domains, and somehow we lost the trust for one federation to the other, and lost the ablility to talk to our main file servers
  • After moving everything over to the new domain, latency has been a huge issue.

We thought the latency could be because of a bad core switch, but restarting that did nothing.

Does anyone have any thoughts on which route I should look into? Thanks in advance!



No comments:

Post a Comment