This really has me stumped... But here goes. I have a Sup720 6506-E with a few BGP peers. Everything was fine, then I decided to upgrade one of my 1G peers to 10G. So I bought a 4-port Xenpak module, WS-X6704-10GE, with DFC, so it shows up as CEF720, the rest looks like this:
router#sh module
Mod Ports Card Type Model Serial No.
--- ----- -------------------------------------- ------------------ -----------
1 8 8 port 1000mb ethernet WS-X6408-GBIC SAD03432184
2 8 8 port 1000mb GBIC Enhanced QoS WS-X6408A-GBIC SAD042102V9
3 48 48-port 10/100 mb RJ45 WS-X6148-RJ-45 SAL0752RE8Q
4 4 CEF720 4 port 10-Gigabit Ethernet WS-X6704-10GE SAL13442VZ2
5 2 Supervisor Engine 720 (Hot) WS-SUP720-3BXL SAL12330437
6 2 Supervisor Engine 720 (Active) WS-SUP720-3BXL SAD0951034L
Cogent is on module 4, my other 1G peers are on modules 1 and 2. We take partial routes, so well within the 512k default limit, but close like 390k IPv4 and 55k IPv6.
As soon as we upgraded the Cogent link to 10G, we noticed that on any given test session, we can only reliably do about 20Mbps outbound. When I say test session I mean I grab a server here thats not doing anything, and upload a 100MB file to a random server I have in the cloud, the cloud server is also barely loaded with good network. The upload maxes out at 20Mbps. Heres the kicker, if I open, say 4 ssh terminals, and do the upload to cloud test 4 times concurrently, each upload still maxes out at 20Mbps, but because I have 4 going at once, so my net throughput is 80Mbps.
Inbound traffic to my router is uneffected, inbound tests maxed out close to 100Mbps.
What the hell could be going on? This router is a very basic edge router setup with BGP, has been running for years. Literally, only thing changed was adding the 10G card and turning up my 10G Cogent peer.
Any ideas?
No comments:
Post a Comment