Upgrade from simple Q-in-Q to VXLAN failover setup

Hi,

right now we are running a SPOF DCI setup for customers in 2x datacenters via Q-in-Q (802.1ad). We now got a second layer2 connection between our DCs and want to setup a failover, non-SPOF Layer2 DCI for our customers. We are going to replace our old Brocade switches with whitebox switches and Pica8 PicOS as software. We thought about using VXLAN for this setup but are now sure if there is a better, cleaner and also not complex solution?

​

Setup now:

• Q-in-Q between Agg switches
• tagged VLANs (10,20,30 on customer switch01 to agg switch)
• untagged port on agg switch to customer switch
• customer Q-in-Q vlan 1000

​

+-------------------------------------+ +-------------------------------------+ |DC1| | |DC2| | +---+ | +---+ | | Q-in-Q via L2 | | | | (VLAN1000) | | | | | | | | +------------------------------------------+ | | | | | | | | +-------------+-+ | | +--------------++ | | | Agg | | | | Agg | | | | Switch DC1-01 | | | | Switch DC2-01 | | | +-+-------------+ | | +-+-------------+ | | | | | | | | | | | | | | | | | | | | | | | | | | | VLANs: | | | VLANs: | | | 10 | | | 10 | | | 20 | | | 20 | | | 30 | | | 30 | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | +-+---------+ +-----------+ | | +-+---------+ +-----------+ | | | Customer +---------+ Customer | | | | Customer +---------+ Customer | | | | Switch 01 | | Switch 02 | | | | Switch 03 | | Switch 04 | | | +-----------+ +-----------+ | | +-----------+ +-----------+ | | VLANs: | | VLANs: | | 10 | | 10 | | 20 | | 20 | | 30 | | 30 | | | | | | | | | +-------------------------------------+ +-------------------------------------+ 

​

Example setup with VXLAN (planned):

• VXLAN between Agg switches
• tagged VLANs (10,20,30 on customer switches to agg switches)
• port-to-vxlan configuration on customer ports on Agg switches
• vni1000 for customer vlans
• let *STP block a port on the least favorite port

​

+-------------------------------------+ +-------------------------------------+ |DC1| | |DC2| | +---+ VXLAN via L3 (vni1000) | +---+ | | | | VXLAN via L3 | | +------------------------------------------+ (vni1000) | | | | | | | | | +-----------------------------------------+ | | | | | | | | | | +-------------+-+ +-------------+-+ | | +--------------++ +-------------+-+ | | | Agg | | Agg | | | | Agg | | Agg | | | | Switch DC1-01 | | Switch DC1-02 | | | | Switch DC2-01 | | Switch DC2-02 | | | +-+-------------+ +-------------+-+ | | +-+-------------+ +-------------+-+ | | | | | | | | | | | STP- * | | | STP- * | | | block | | | | block | | | | | | | | | | | | VLANs: VLANs: | | | | VLANs: VLANs: | | | | 10 10 | | | | 10 10 | | | | 20 20 | | | | 20 20 | | | | 30 30 | | | | 30 30 | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | +-+---------+ +---------+-+ | | +-+---------+ +---------+-+ | | | Customer +---------+ Customer | | | | Customer +---------+ Customer | | | | Switch 01 | | Switch 02 | | | | Switch 03 | | Switch 04 | | | +-----------+ +-----------+ | | +-----------+ +-----------+ | | VLANs: | | VLANs: | | 10 | | 10 | | 20 | | 20 | | 30 | | 30 | | | | | | | | | +-------------------------------------+ +-------------------------------------+ 

​

Additional information:

• customer switches are less expensive (no VXLAN, MPLS, whatsoever feature)
• yes, customer needs layer2
• MPLS should be possible on the Agg switches, but seems too complex for this simple setup

​

Thanks for reading up to this sentence :)