ASA unable to form an OSPF neighborship with a router with multiple SVIs

Curious as to why this wouldn't work. Here is the design.

Cisco ASA with a trunk link to a layer 2 switch. That layer 2 switch has multiple routers and each router is in its own vlan. Each router is a connection point to a customer.

Running OSPF between the asa and each router allows the ASA to have multiple adj over a trunk link. So far so good and pretty standard.

The funkiness comes in when let's say there is a router with multiple SVIs. The ASA will ospf adj with one SVI but it will not form an adj with the other SVI. Can anyone figure out why this is an issue for the ASA?