Tuesday, September 28, 2021

The inevitable "Why are my transfers so slow" and how to fix it

Greetings everyone,

Our company connects sites using MPLS and S2S IP Tunnels.

There is a requirement for file synchronization between three primary sites (US site hands off to China site to keep 24/7 development in play). As always, due to the latency involved the file transfers are less than optimal , especially considering the size of the syncs.

The files that need to be transferred are several hundred and about 100GB a night. Primarily US to Taiwan, then Taiwan to US.

  • Site: 1 - USA
  • Site: 2 - Taiwan
  • Site: 3 - China - Mostly sources files from Taiwan.

My IT team is struggling with how to improve this - sftp, scp, MT robo copy while showing some marked improvement, are still unacceptable.

We are planning to install direct 1GB MPLS links between the sites (I know, latency) - so what are some more tricks I can try? Should I just purchase hardware network acceleration devices? The other thought was using a service like raysync.io.

Any thoughts or insight greatly appreciated!



No comments:

Post a Comment