Hi @JBLaing, once you have the vault switcher open, have you tried closing the “mistake” vault before trying to remove it?
Just in case you didn’t know, Obsidian will open the last vault you closed by default. Once you’re done with the “right” vault, and close it, that will be the vault that will be opened by default.