Can't wrap my head around GRE

I understand that it's used in a VPN and I understand that it makes 2 routers seem level 2 adjacent, but why does it matter? How is it different than 2 routers forming a connection over the public internet? After all, the data takes the same path either way.