Obsidian Graph view doesnt work for a large Vault

[osmanf]

This vault is open source. Here you can get it: GitHub - osbm/nixpkgs-vault: A large obsidian vault with 130k notes

It takes around 10 minutes to index the vault. (Not unexpected honestly)

I have a powerful computer, processor intel i7-14700KF and 64 gb ram and nvidia 4090. Accelerated graphics are enabled. And there is no 3rd party plugin.

I chose to represent the data inside the nixpkgs repository with this format because i thought the graph view would be cool and i could do bunch of visualizations and try out the new feature Obsidian Bases.

Graph view freezes. Even a local graph view window freezes if i increase the depth to just 1.

The problem is that obsidian doesnt utilize my GPU even though i enabled the Graphics Acceleration and doesnt utilize CPU if i turn it off. It just uses 1 core to 100% and only thing that freezes on my system is the obsidian.

I have many questions:
Is there anything i can use Graph view?
Does this vault works on your machine?
Is a 130k note vault pushes the limits too far?
Is there a CLI tool to let me do the indexing?
Is there a tool that can utilize my entire GPU or multi core CPU to just generate a full screenshot of the Graph View? I dont even care if its interactive at this point.

[rigmarole]

@osmanf

Is a 130k note vault pushes the limits too far?

Have you tested on a smaller vault to isolate that it is in fact the vault size that is the issue?

[CawlinTeffid]

This doesn’t surprise me (well, the result doesn’t; the lack of GPU usage does). A test of an older version of Obsidian with 100,000 notes found that altho most things worked well, the graph crashed. (I’m not sure how their hardware compares to yours.) https://web.archive.org/web/20220522204944/https://www.goedel.io/p/interlude-obsidian-vs-100000?s=r

[osmanf]

I deleted 100k notes and it is able to show the graph of about 29k notes.

[WhiteNoise]

@osmanf

Is a 130k note vault pushes the limits too far?

Yes. There is not a hard limit but the performance of graph view degrades with the number of notes. I don’t think anything above 25K files is practical with a modern desktop computer.

This is not a bug but a current limitation. Feel free to search/open a FR asking to optimize global graph view to work with larger vaults.