vEdge and Core P2P high latency?

Hi All,
I would like to seek your inputs regarding the issue with latency on Point-to-point connection under service vpn. We have vEdge in where the Cisco core 1 and 2 switch is connected.. At the time of the issue, I'm seeing that latency increased at approx. 300ms which normally is just below 10ms.

Issue is gone now and connection is back to normal... Just thinking what could go wrong? it is unlikely that both core switches are having issues and now pointing to vEdge.. 

Here's the topology. https://ibb.co/MVxfGNx 

I checked the following. 
  > interface error, device resources (CPU / Mem) , version 20.3.x 

Any inputs on what issue can potentially affect the issue? Possible on L2 or L3 of the service VPN?