# Indexing Large Number of Files - Still Not Working

**URL:** <https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475>\
**Category:** Bug graveyard\
**Created:** [November 11, 2022, 10:37pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475 "2022-11-11T22:37:49Z")\
**Posts on this page:** 11\
**Page:** 1

<div class="post-metadata">

**Author:** ![gda](https://forum.obsidian.md/letter_avatar_proxy/v4/letter/g/bbe5ce/32.png) [@gda](https://forum.obsidian.md/u/gda)\
**Post date:** [November 11, 2022, 10:37pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/1 "2022-11-11T22:37:49Z")

</div>

Continuing the discussion from [Indexing Large Number of Files](https://forum.obsidian.md/t/indexing-large-number-of-files/47397/6):

### The BUG is not resolved!

- Obsidian still does not finish the indexing. It either hangs or closes itself without any input
- Obsidian indexes about 80K to 128K of the 251K files then hangs or closes itself (the number indexed varies each time)
- When it hangs, nothing on the window responds to mouse input

### History

- Everything was indexed and syncing well until I added over 247K small md files

### Troubleshooting

- I have since disabled ALL of the plugins, both core and community
- I am currently using the default theme
- I tried deleting the obsidian directory in .config and the .obsidian directory in the vault to force obsidian to start fresh
- Attempted to launch obsidian via the cli. Received the following:

```auto

2022-11-11 22:00:11 Loading main app package /usr/lib/obsidian/obsidian.asar
xdg-settings: default-url-scheme-handler not implemented for xfce
2022-11-11 22:00:11 Checking for update using Github
[12277:1111/160011.175472:ERROR:sandbox_linux.cc(377)] InitializeSandbox() called with multiple threads in process gpu-process.
[12277:1111/160011.178921:ERROR:gbm_wrapper.cc(275)] Failed to export buffer to dma_buf: No such file or directory (2)

A whole lot more of those error messages, then the following:

[12277:1111/160011.180156:ERROR:gbm_wrapper.cc(275)] Failed to export buffer to dma_buf: No such file or directory (2)
2022-11-11 22:00:11 Success.
2022-11-11 22:00:11 Latest version is 1.0.3
2022-11-11 22:00:11 App is up to date.
Trace/breakpoint trap (core dumped)

```

### Vault Info

- Total items (including directories) - 251,602
- Total size - 921.1 MB
- File types & quantity (other than md):  
– ods = 15  
– odt = 28  
– pdf = 27  
– jpg = 287

### System Info

- Obsidian version v1.0.3
- Electron version 20.0.3-3
- OS: Arch Linux
- Kernel: x86\_64 Linux 6.0.8-arch1-1
- Uptime: 6h 37m
- Packages: 795
- Shell: l
- Resolution: 3849x2160
- DE: Xfce4
- WM: Xfwm4
- WM Theme: Galaxy
- GTK Theme: Adwaita [GTK2]
- Icon Theme: Adwaita
- Font: Roboto 12
- Disk: 1.3T / 4.6T (29%)
- CPU: AMD Ryzen 9 5950X 16-Core @ 32x 3.4GHz
- GPU: Advanced Micro Devices, Inc. [AMD/ATI] Pitcairn XT GL [FirePro W7000]
- RAM: 5696MiB / 128730MiB

---

<div class="post-metadata">

**Author:** ![WhiteNoise](https://forum.obsidian.md/user_avatar/forum.obsidian.md/whitenoise/32/11_2.png) [@WhiteNoise](https://forum.obsidian.md/u/WhiteNoise)\
**Post date:** [November 11, 2022, 11:16pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/2 "2022-11-11T23:16:43Z")

</div>

As i told you in the other message. We do NOT support this many files at the moment. I do not consider this a bug.

Efforts on expanding Obsidian limits are ongoing and are not bugs.

---

<div class="post-metadata">

**Author:** ![WhiteNoise](https://forum.obsidian.md/user_avatar/forum.obsidian.md/whitenoise/32/11_2.png) [@WhiteNoise](https://forum.obsidian.md/u/WhiteNoise)\
**Post date:** [November 11, 2022, 11:27pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/3 "2022-11-11T23:27:35Z")

</div>

Also we don’t make the arch package and we don’t support it. Next time you file a bug report make sure to try the appimage or snap.

---

<div class="post-metadata">

**Author:** ![gda](https://forum.obsidian.md/letter_avatar_proxy/v4/letter/g/bbe5ce/32.png) [@gda](https://forum.obsidian.md/u/gda)\
**Post date:** [November 11, 2022, 11:50pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/4 "2022-11-11T23:50:49Z")

</div>

You never said obsidian does not support this number of files. you said, “We are aware that there’s currently an issue in electron on linux that caps the memory utilization at 4gb”

I have seen lots of notes asking about a file limit but so far, I haven’t seen any answer to those questions.

---

<div class="post-metadata">

**Author:** ![WhiteNoise](https://forum.obsidian.md/user_avatar/forum.obsidian.md/whitenoise/32/11_2.png) [@WhiteNoise](https://forum.obsidian.md/u/WhiteNoise)\
**Post date:** [November 11, 2022, 11:57pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/5 "2022-11-11T23:57:24Z")

</div>

I said that you may have hit the limit of what obsidian can currently handle. Which is the same thing in my mind. Maybe i was more explicit this time.

Maybe there will be some sprint in the future to push the current limits, but I don’t consider this under the category of bugs.

---

<div class="post-metadata">

**Author:** ![gda](https://forum.obsidian.md/letter_avatar_proxy/v4/letter/g/bbe5ce/32.png) [@gda](https://forum.obsidian.md/u/gda)\
**Post date:** [November 11, 2022, 11:59pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/6 "2022-11-11T23:59:57Z")

</div>

You may not consider it a bug, but the dictionary does

“A software bug is an error, flaw or fault in the design, development, or operation of computer software that causes it to produce an incorrect or unexpected result, or to behave in unintended ways.”

Unless you did in fact intend to limit the number of files. If that was the case, you should have stated so in the documentation

---

<div class="post-metadata">

**Author:** ![gda](https://forum.obsidian.md/letter_avatar_proxy/v4/letter/g/bbe5ce/32.png) [@gda](https://forum.obsidian.md/u/gda)\
**Post date:** [November 12, 2022, 12:00am UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/7 "2022-11-12T00:00:48Z")

</div>

BTW, the appimage from your website doesn’t work either

---

<div class="post-metadata">

**Author:** ![WhiteNoise](https://forum.obsidian.md/user_avatar/forum.obsidian.md/whitenoise/32/11_2.png) [@WhiteNoise](https://forum.obsidian.md/u/WhiteNoise)\
**Post date:** [November 12, 2022, 12:16am UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/8 "2022-11-12T00:16:27Z")

</div>

It’s not a bug, we do not currently expect Obsidian to work with that volume of data. I am sorry.

---

<div class="post-metadata">

**Author:** ![rigmarole](https://forum.obsidian.md/user_avatar/forum.obsidian.md/rigmarole/32/29973_2.png) [@rigmarole](https://forum.obsidian.md/u/rigmarole)\
**Post date:** [November 12, 2022, 1:58am UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/9 "2022-11-12T01:58:44Z")

</div>

> [@gda](#):
>
> I have seen lots of notes asking about a file limit but so far, I haven’t seen any answer to those questions.

> [@Maximum Number of Notes in Vault](https://forum.obsidian.md/t/maximum-number-of-notes-in-vault/1509/5):
>
> We stress tested against 20k Markdown files (found here: [https://github.com/Zettelkasten-Method/10000-markdown-files](https://github.com/Zettelkasten-Method/10000-markdown-files)), and it works okay on a relatively fast desktop computer. We’ve done extensive optimization on file explorer and search, but the initial loading and processing could take some time for sure. Haven’t seen real-world cases that would require more, unless you want to for example display Wikipedia inside Obsidian.

What’s your use-case, if I may ask? It’s none of my business, I’m not a dev. I’m just asking out of curiosity.

---

<div class="post-metadata">

**Author:** ![gda](https://forum.obsidian.md/letter_avatar_proxy/v4/letter/g/bbe5ce/32.png) [@gda](https://forum.obsidian.md/u/gda)\
**Post date:** [December 5, 2022, 3:34am UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/10 "2022-12-05T03:34:27Z")

</div>

Sorry for the very late reply. I didn’t receive a notice about your comment.

I am building a cross-linked Bible using the BSB. There about 500K Hebrew / Aramaic / Greek words in the BSB translation. The people at the Berean Study Bible provide a free spreadsheet with each of the word and additional details

I wanted to link each of those words to the English translation on a verse by verse basis and link them to a summary file.

I can provide more details if you are interested.

---

<div class="post-metadata">

**Author:** ![WhiteNoise](https://forum.obsidian.md/user_avatar/forum.obsidian.md/whitenoise/32/11_2.png) [@WhiteNoise](https://forum.obsidian.md/u/WhiteNoise)\
**Post date:** [December 5, 2022, 2:20pm UTC](https://forum.obsidian.md/t/indexing-large-number-of-files-still-not-working/47475/11 "2022-12-05T14:20:23Z")

</div>

Closed on December 5, 2022, 2:20pm UTC


