We are currently under the impact of the "Camp" wildfire) in Northern California, which destroyed the city of Paradise and still threatens surrounding areas.
Our org serves as regional ISP to all county's schools. The fire burned through several of our circuits (Comcast EPL and dark fiber), and shut down the county's residential/business CMTS for most of Thursday/Friday. Most consumers and businesses were without Internet
Thankfully Comcast was extremely responsive in repairing the most critical circuits as soon as possible, and the CMTS is now back online. Several branch offices/sites remain offline, however.
Given that the network is critical information infrastructure especially in times of emergency, what can we do to mitigate downtime in the future? We have redundant 10Gb circuits from our office to our upstream ISP, which worked exactly as planned when our primary circuits were down. However all circuits to our node sites are not currently redundant.
What's best practice in 2018? DMVPN mesh where each site gets 2+ circuits over diverse carriers? SD-WAN? Maybe WiFi p2p to sites with clear LOS? Specifically interested in L1-3 topology considerations.
BTW: we are safe, and have validated offsite backups of everything, generator-backed DC, etc.
No comments:
Post a Comment