Using the Delete keys while cursor is within the empty auto paired quotes (or other formatting) seems to always works for me.
However, you are right, when using the Backspace key that it will delete the character before the cursor thus removing the paired formatting character as well. So in this particular instance, the Delete key is the way to go.
Thanks.