Thursday, April 30, 2020

What “proof” should I get to have someone look into an issue I feel we are having?

Have 1Gbps business line from Comcast that we manage in our lab. Enterprise recommends we swap to the “enterprise lab infrastructure” that they manage.

The problem is the throughput is total crap compared to what we currently have.

Our lab ran internet connection is a Comcast 1Gbps business line. The enterprise one is supposedly a 1Gbps CenturyLink connection they route around over their MPLS circuits in the same city but eventually hits the 1Gbps CL (at least that’s what I gather).

There shouldn’t be any issue to the “end user” between the two. I can understand some variance but the CL connection is a total dog for throughput in comparison to basically 95% of sites. Yeah you can pull up a browser and browse around but downloading any type of packages (OS packages, datasets, etc) it’s way slower than 90% of them.

We noticed it when updating our servers with drivers (like 400MB NVidia drivers) from Ubuntu mirrors. Our old connection could easily download this at 50-60MB/s (400-500Mbps) and be done in seconds. The new connection we get like 1-5MB/s (10-50Mbps).

After seeing this from multiples sources. I went and did some testing from vultr, AWS, FDCServers, Ramnode, DigitalOcean etc. Downloading files from those data centers in the same city (Seattle) on the old connection with 3-6ms pings we can get 80+MB/s. Most of them are 90+MB/s. The new connection varies from 8-12MB/s on one test from one of the providers and all the others are between 2-5MB/s (in seattle).

Running tests from different city’s LA, San Fran, Denver, ATL, Chicago, NYC, Washington DC. The Comcast connection slows down some depending on the distance but it’s routinely above 30MB/s on all of them. The new “enterprise” connection is between 1-2MB/s.

I ran the same tests on my home connection (Google Fiber) across the country (AL) to these same data centers in Seattle and get better speeds than this “enterprise” connection.

I’ve complained about it and enterprise just tells me “it’s the general internet” we can’t do anything. I’m like there HAS to be something wrong somewhere otherwise this thing is borderline useless. If it’s the “general internet” get CL to prove that because this thing is dog slow to EVERY damn site. There is not a single site it’s even close on. Then they just tell us our TCP window size is too small or some shit when basically the same system 2 feet away is getting 80MB/s.

I tested about 15-20 different sources spread across the country. And the comcast connection never had one below 10MB/s (100Mbps) even from ATL to Seattle or Washington DC to seattle. The new connection I think there was 1 or 2 that was 10-15MB/s the rest were in the 5MB/s even from Seattle.

Is there anything that you would want to see that would be hard to deny that there is a problem? Maybe it is the “general” internet being shit and CL is total shit in their peering or routing or whatever but is there anyway to prove that? Or am I just wrong and CL is just that bad?

If you would like to see my test results I can share if needed.



No comments:

Post a Comment