I think this could work if there was a “bigger” feature where the graph view responded to advanced search queries. Something like all the books tagged as #something and #toread so that you could see which ones were linked to by other sources most.
In theory you could then do something like !#journal and that would exclude any journal entries from your search. Maybe even be able to save searches like this, or set a default view search?