I need help! Multi-switch setup causing major latency issues. Network diagrams attached. Very slow RDP\VNC, SFTP on LAN.

Thank you for reading!
Please see diagram of my setup: https://imgur.com/pMfyyyE

Okay, These 2 unmanaged switches are in completely different wings of the building, 150-200ft away. I know that the cable ran is fine, because when it bypasses switch#2, there are no issues at all.

So when it is coming through switch 2, I have the terrible latency issues. VNC/RDP is terrible, SFTP is terrible, download network speed is terrible.

So one of my troubleshooting steps was just to connect the long run directly to the PC, and it worked GREAT! Everything was meeting expectations, so I thought, "there must be something wrong with switch 2", simple, or so I thought.

Switch #2 was already brand new netgear 16 port passive switch, so I fully replaced it with another brand new one. I even replaced the power cord. Same issues persist. I am really scratching my head.

PC>Switch1>150ft-cat5e>Switch>PC = Broke AF
PC>Switch1>150ft-cat5e>PC = No issue at all

And again I have replaced that second switch with no change whatsoever. I have also used multiple known working cat5e between switch2 and host-PC. I have troubleshooted this so much, and I have no idea what else it could be. It is possible that I received 2 brand new yet defective switches, but that is highly unlikely.

Other troubleshoots:

I have verified that I have no switching loops on my network

Right now, only 2 ports are being used on switch 2. Network in, and the PC connection. Noting else is plugged in to switch2

I have tried different cables

I have tried different ports

I have replaced brand new switch#2 with another brand new switch

It makes no sense, and I have done all the troubleshooting that I can think of. Please help. Thank you so much!