Routing between 2 VLANS.

So im currently getting my feet wet with creating VLANS and understanding how they work in my lab envoriment i have set up, just so we know what we're working with, i've got 2 netgear prosafe switches & a Draytek router

Currently i have the 2 switches (switch 1 and 2) set up with 2 different VLANS, VLAN 4 (172.16.4.x/22) & VLAN 12 (172.16.12.x/22), with the router having a port in each VLAN (Both connected to Switch 1) and a trunk port setup to use both VLANS between both switches.

I can communicate inside each VLAN absoloutely fine between each switch through the trunk port, and i can route between each VLAN on switch 1, but cannot route between each VLAN through the trunk port, and i cannot route between each VLAN on switch 2.

Any ideas on what im doing wrong here?