How do you permanently remove a switch from a stack? (Cisco)

I have 4 Cisco Catalyst 3650s in a stack, sw1-sw4 for simplicity.

I had to do some renumbering to get them all in the order that I wanted where the physically top switch is sw1 and has g1/0/1-g1/0/48, the second switch was sw2 and so on and so forth.

My issue is that I had made one of the switched number "5" while shuffling them around, and now I have 5 switches showing up when I run #show switch and I have g5/0/1-48 in my config.

I've already issued the #no switch 5 provision ws-c3650-4pd command, but now the #show switch output just lists the 5th switch as "unprovisioned".

What am I doing wrong or missing?