Saturday, April 24, 2021

Nexus vxlan/evpn multisite VTEP-PIP loopback delayed up after reboot

I am having a vlxan/evpn multisite setup with VPC-BGWs (the legacy site DCI case) with nexus 9k3 (nxos 9.3.7). The setup works fine, with two nexus in VPC on one side and another two nexus in VPC on the other side.

When i reboot one of the nexus, traffic continues to flow fine but when the nexus comes up again and restores the VPC portchannels, traffic stops flowing. I can see that VTEP-PIP loopback is down (nve is up) and BGW loopback is also down. When the VTEP-PIP loopback goes up, traffic starts flow again and after the "delay-restore time" the BGW is also up again.

The problem is that VTEP-PIP loopback takes anything from 30 to 250 secs to go up, which means traffic stops for that period, which is bad and i can't really understand why. Let me also note, that while this happens and traffic is not passing through, all the IPs of VTEP PIP/BGW are reachable (they ping) from both nexus of the other site.

Any ideas why the VTEP-PIP loopback takes ages to go up after reboot and why traffic stops flowing?



No comments:

Post a Comment