We are using Ctrl-E to open and close preview. I suggest to make Ctrl-G hotkey to act exactly like this: allowing the Ctrl+G to open and close the Graph view and return to the previously selected note.
Ctrl-E
Ctrl-G
Ctrl+G