[Feature] [Implementation] Alternative to Nested Vaults to Save on RAM resources

Share & showcase
1

Platform

[ X] iOS
[ x] Android

Obsidian Mobile version: v0.15.6

Hi all,

I have been testing on iPad only yet, so I semi-ticked for Android for possible future use on that platform and of course the same question can be asked by Android users as well.

Issue:
I have a vault of 15000 items sorted into A-Z subfolders (it’s a mini-lexicon basically) and a main assets folder to link to individual entries having images.
My workflow necessitates having (at least/only) two apps in the foreground, Obsidian being one of them, but while I am out of Obsidian for a little while, the app just doesn’t seem to be able to stay available and needs to be restarted. A leaner vault with other projects doesn’t do that.

Workaround:

  1. Use an MD Editor to access my folders/files and edit them outside of Obsidian. This is not what I want to do, as i cannot edit backlinks and I cannot work with images during my workflow. And generally I like to learn or automate my finger movements for my workflow, otherwise I break my (brain) flow/zone.
  2. Trying to access only a portion of the vault to save on resources used by iOS and not have Obsidian exit on me.
    This is what I’m trying to work out but at this point I cannot think of anything else but a way to access subfolders (A, B, C, etc.) as subvaults, which I believe would involve nestled vaults (at this point I don’t even care about graphs or anything else, although the need for a right approach must be thought out thoroughly to forego future issues and the only way to test large amounts of data is to use your own precious data you accumulated for years and years).

I am on an iPad mini 4 running iOS 15.5 and have not been happy with it. My service guy installed it without consulting me and I tend to think that my iPad is not working to the best of its ability, so I don’t even know that other people are having similar struggles or not (mainly to to with iOS versions or anything else).
It is possible that my Obsidian struggles are aggravated by personal/technical (hardware/software) issues. I do not know…

I want to do my main work on the light iPad and not on PC, so this is top priority for me.

Question:
Does anyone have an idea how to offload on a heavy main vault while retaining vault-specific functionality that would not involve creating nestling vaults (as it can be risky)? (In the meantime, I’d still have to try it, of course, after making some backups.)

I was looking around on the forums (elsewhere too) and saw ideas for Focus and Workspaces as alternatives to nested vaults and I don’t know any updates on those ideas or how exactly they could help with my case. I want full functionality and less resource dependency. Please don’t anybody tell me I can’t have my cake and eat it.

Anybody using maybe a plugin that helps with my case?
Anybody using a working workaround I might be interested in?

Cheers

2

In the end, I’ve found a straightforward method.
I am writing it up for the benefit of others.
(You see many times you’ll come up with a solution for yourself but writing about the problem and the pressure that you laid yourself bare that is showed your stupidity and lack of imagination online for all to see will make you work harder; external pressure for a lot of people is greater than internal.)

Create a dummy vault which you can call Prep- something, or anything.
I was thinking of creating a shortcut that uses Obsidian URI to fetch (copy) the file specified (to be inputted) in a pop-up, but since sometimes I don’t recall the actual name of the note and would need to look it up, why would I not set up the Files app in two panes and drag and drop from one folder (vault) to the other (this results in a move) while I’m at it? When I’m done editing, I move the note back to the original place with the same drag and drop. No need to remember to sync files back later either.
In case I’d need to do that, I use FreeFileSync (which I use to transfer everything to Android as well).

I am not quite pleased with this workaround but it will have to do for now as I already spent nearly two weeks porting my research to the new environment (PanDoc did not work out for me) and need to go back to being productive.

Thanks for reading

Cheers

3

The above were two old posts of mine where I was struggling/trying to figure out how best to approach tablet work with lots of converted files in my new environment.

Since then, I know a little bit more.

Unfortunately, a large vault doesn’t really work a hundred percent well in the latest updated versions of Obsidian mobile, either. Not only does it take a long time to open the vault, the app has a way of exiting itself easily. Moderators think it’s the RAM (of an older device). I think there are some other issues there as well (possibly to do with folder structure and caching – I am no developer, of course).

So it came that almost a full year passed and I tried coming back to the original idea, namely cutting up the vault into smaller pieces (in my case, folders A-Z). An off-the-cuff half-hearted effort on my part looked like this:

In the hours that followed that post, at least I managed to find a working solution (which doesn’t need a jailbreak but it certainly makes it a little smoother).
Basically, after syncing (in my case: with GitHub) that is pulling data down, I move all my subfolders (now equipped with their own settings in their own .obsidian folders, which I set up on desktop) up one level so they’ll all be on the same root/vault level path (Obsidian on iOS only lets you do that): where the main vault sits.
One can do it using A-Shell (first accessing the Obsidian container with pickfolder-jump commands) and even automate it all with iOS shortcuts.
Then when the work on mobile is done, move all folders back to the main vault and now you can sync (in my case, I use git).

First I used the Filza (JB) app to do the moving but now I use the shortcuts (in my case, it was very easy because regex [A-Z] matched and took care of moving all my A, B, C…Z named folders).

In the meantime, I set up other shortcuts to access the temporary vaults and their files. The experience is really good. Switching vaults is really fast (moving a lot of files beforehand was equally really fast – don’t move files in the iOS Files app, that’s rubbish).

If you want to follow in my suit, I just need to remind you that first you need to set things up by creating the dummy folders (with the same name that your prospective subfolders have, obviously) in Obsidian, then quit Obsidian, delete the dummies (in Files app, if that’s what you have), then do the moving, and enjoy.

1 Like
4

As for the setup part, regarding creating dummy folders/vaults, it turns out to be not necessary; it was just a security measure on first try. Omit this step then.

5

Also, in A-Shell, if you pickFolder into your Obsidian vault, with pwd -P you can check and copy out the absolute path with the UUID and use that path to make moving folders smooth (rather than playing around with the jump command). So your shortcut would look something like this (this causes only one folder to be moved):

image
image1536×1137 245 KB

Then, as for moving back (to use your full vault again or in preparation for sync):

image
image1536×1126 234 KB

6

Amazing creative workaround solution!
I have found that on my iphone 11 with 4gb of ram, it helps when I let Obsidian play an empty 6h long audio file in the background.
It seems that iOS prioritizes apps that are playing audio when force closing apps to free up ram.
Here is a bit more detail: [Feature] Background sync - #33 by chrsle

PS: restarting the device once a week seems to help, and not running too low on storage space seems to help as well- although I don’t know how low is too low.

7

If it was your idea – I seem to remember it was – I tried it when you published it, but it didn’t work out for me.

In my case, the old girl is 2GB (1GB full ass) but as I said, I don’t think it’s solely a RAM issue.

8

Sorry to hear it didn’t work for you! Maybe 2 Gig is indeed too little.
Did you try both, audio and video? After running with it for a few weeks, the audio solution seems to be more reliable. Keep in mind, once you play any sound, Obsidian’s audio will he stopped. You can check that in tue control centre.
a good way of testing is by using a white noise file, e.g. from here: White Noise for Baby Sleep - Mp3 Download

1 Like
9

I only tried the video bit, but I’ll surely try the audio version as well. Thanks for the elaboration.

10

I just tested it on my old iPhone 6s with 2GB Ram, and it seems to work fine.
If it works for you too, you can use this 6h silent mp3 file: Dropbox - 6-hours-silence.mp3 - Simplify your life

11

Cheers, mate.

I’ll have a look into it tonight.

12

Didn’t pan out, I’m afraid. Two apps side by side – no. Pressing sleep button and coming back a half-minute later – again, it quit on me.

With my method, I can run apps simultaneously and have iPad sleep and come back to the previously opened (now smaller sub)vault.

I’ll try something else to ease my pain with the large vault in the coming days: delete cache (with jailbreak) and cut down on installed/activated plugins.

  • For me, Plugin Manager (you know the one) was more of a pain then help. I disabled it. There was no significant difference in the time plugins loaded at startup, yet once in the vault (and having Plugin Manager enabling the remaining plugins by the rules I set), I felt the interface heavier and more unresponsive than without using the plugin.
13

I don’t remember if it was plugin manager or plugin groups, but one of the two also didn’t do anything for me to reduce startup time. TfTHacker’s FastStart script however works really well.

I’m sure you know these already but just wanted to mention it: Taio and Notebooks can edit markdown in other folders on iOS. (I think 1Writer and iAWriter might be too.)

It’s a bummer that there isn’t a jailbreak tweak that enables keeping an app permanently in the background.

14

I used that script before; again, I didn’t detect any noticeable difference (my complete initialisation from pressing the vault button and arriving in it so I can start typing/searching takes 42-45 seconds, so 2-3 seconds is not much of a gain).

I used to be a bit of a Taio ambassador but now I use it less and less, mainly because my workflow with the Various Complements and Typing Transformer plugins necessitates my being in Obsidian. I like to learn my automatisms in one environment.

Also, I notified the Taio dev about a serious issue of duplicating lines in heavier documents – say 150-300 kbs – which also feel heavy in Obsidian mobile but the duplications inside the file don’t seem to come from Obsidian.

There is also MWeb on iOS which supports showing your images in editing mode but it only uses markdown formatting and you cannot click on links to navigate yourself in your vault, which you can do in Taio (which is not an Electron app and does not load your whole vault to be able to work).

So the problem here is basically Electron and the whole concept. Electron is very resource-heavy but I don’t remember having Chrome or Edge just quit on me like that on iOS – no matter how many tabs I had.

15

Also, I read that the more backlinks there are, the longer the load time. I have over 150.000 links. It’s all to do with the vocabulary-oriented/lexicon-like data entry not really suited for the app, but Obsidian is the best product I could find.

16

This method also makes it possible to move the complete (or part of the) vault to figure as a Logseq graph.

17

Spaces in folder and file names must be escaped by backslashes. %20’s and quotation marks didn’t work.

For example, for moving folder name 01 Home,

  • Works: 01\ Home
  • Doesn’t work: 01%20Home, "01 Home"
18

The method works well with the Obsidian Advanced URI community plugin (even when called outside of Obsidian, through Siri Shortcuts), which can target files at heading and block level as well.
Special characters in the full URL need to be double encoded, except for the space character (%20 is fine).
Files not present in the currently open vault can be called with the Obsidian Shortcut Launcher plugin from within Obsidian as well (you initiate the Siri Shortcut from within as you’d do normally with a share sheet). As I said, the easiest is to have these subvaults named A, B, C, etc., which will act as Vaultnames.

  • Single capital letters in initial position are easy to parse in the Shortcuts app and easy to move en masse (regex [A-Z]) with A-Shell.

I have now successfully set up a work environment where I can access any file (at any heading or block) in my main vault and not worry about Obsidian hogging too much RAM or exiting on me.

Another tip:
The [[Files#Headings]] (or blocks with ID’s) can be put into a custom dictionary of the Various Complements plugin (with as many aliases as you like as well!), which is really handy with finding otherwise elusive text blocks.

  • Run regexes on your vault in Notepad++, copy the results of your links with headings, run some regex replacements to equip your full links complete with headings and copy the results to a txt file you specify as your custom dictionary in VC.
20

In the end, I still went back to the original idea. One TEMP vault.

I have a Siri shortcut that moves over the markdown file along with each image corresponding to this file. This process could be done with A-Shell but since I have JB, I use a local SSH action with a full shell script I whomped together with the help/hindrance of a cheap chat robot.

I also have various WorkSpace shortcuts where a full array of pre-defined markdown files along with attachments images are moved over and I open the workspace with those files (with Obsidian Advanced URI).
So I can work with any file with any leading character (not like before, when I had to switch vaults) in any self-defined group/topic.

Then I have a shortcut that moves back all files from the TEMP vault to the Master Vault.
Should I want to go back to using one of my A-Z sub-vaults, I included a script in the MoveBackTemp shortcut which updates any plugin that has been upgraded while in the TEMP vault. Some plugins needed to be excluded from the sync.

  • With JB, one can install any command to be used in a Siri SSH action. Rsync, ripgrep, fzf, awk, etc.

The working experience is flawless, especially because I am using other plugins necessary to have a seamless interaction with files/references not yet in the TEMP vault. One of them is the Various Complements plugin.

  • Another subscript in MoveTempBack syncs my VC dictionary files to a folder in the Master Vault, so any new items I put in there would be available on PC as well. Of course, any changes made to these dictionary files on PC (if any) need to be synced back to the TEMP vault as well.

When I have done enough work for the day (I like resting my back and reading on and generally working with the iPad), I press one shortcut again that includes MoveBackTemp and syncs with GitHub. Again, I use SSH (and NewTerm).

22

The real solution: Buy an iPad with M1 chip.