Available high scale virtual routers - alternatives to Mikrotik CHR

Hello,

At my company where we have a pretty high scale network (5000+ devices) we are hosting our core network on our own appliances in a datacenter. We are working with a lot of Mikrotik devices so as a result we are using the CHR images on vmware for routing in our DC.

Lately we have some issues with the performance of the Mikrotik CHR images in combination with our AMD Epyc processors. When we route about 1Gbps throughput through an appliance with 4 threats we notice a cpu load at about 60%. Doing the same with FRR we are able to route 1Gbps of packets at about 20% cpu on 2 threats.

We have this issue since we swapped our servers from Intel CPU's to AMC Epyc's. We have had numerous support cases on this matter with Mikrotik, VMware, ... After about a year debugging on this matter we are now looking at other options.

Are there any recommendations? Currently we are looking at virtual Cumulus appliances as an option. Also VyOS is currently being looked at. Any experience sharings with these are appreciated.

Features that we use:

• BGP
• IPSEC / L2TP /PPTP/SSTP
• VLANS
• LLDP
• Radius / LDAP
• STP / RSTP / MSTP
• LACP Bonding
• DHCP (with options, relay)
• NAT
• Firewalling
• Policy Based Routing
• SNMP

optional:

• VxLAN
• Wireguared
• Linux Shell (iperf, tcp dump, dig, nmap, ....)

Any help is appreciated, if you want more info on our setup, just let me know!