How are you closing the window? Maybe you are actually quitting the app?
When I close using the red X button, or the “Close Window” menu item, it closes the vault, but the app still stays open.
Maybe helpful: There was a discussion about this where you can assign a hotkey to close window: Command + W shortcut - #5 by rigmarole