We want to change the hardware of our default gateway, will a hardware change cause an issue if IP stays the same?

Sorry for the strange wording. Essentially, say all of our clients have a default gateway of 1.1.1.1. We decided that 1.1.1.1 isn't the device we want to do our routing on so 1.1.1.1 just forwards everything to 2.2.2.2. Now it make sense to just have all clients go to 2.2.2.2 instead and have 2.2.2.2 set as the default gateway, but we have many devices with hard coded default gateways which can make this a challenge.

Could we just swap the ip addresses of the devices without causing an issue? In this example, if I were to change the ip address of 2.2.2.2 to 1.1.1.1 so clients will be going to a new device, but we wont have to go in and change these hard coded default gateways. We are concerned there could be some strangeness with ARP or something else weird. In theory it should work, what should be my concerns?