I think this should be toggleable, like how you can change the Filters or Groups.
My preference is at the very bottom of the note. Even if the user doesn’t want it there, he’ll know where it is and then move it while still preserving the integrity of both the note and the graph.
(I’m happy to see others enthusiastic about this feature.)