Free, local, personal LLM/AI using Obsidian notes

Putting this here if it helps anyone (and in case I get good corrections or tips): :slight_smile:

I wanted to make use of AI to extract information from all the data in my Obsidian notes - and on my websites. Private, offline, and if possible, free and simple to set-up.

So, I made a local LLM work on my Windows PC, using (for now still) free software, and no Docker.
As simple and idiot-friendly as it gets.
DeepSeek wrote a well-functioning WordPress website scraper, so I could feed all my public knowledge (from my websites) - along with my private Deathnotes.

Here is an example:

Why is this impressive? Because I’m a huge fan of anti-seize mounting pastes and use them on practically every bolt! :slightly_smiling_face: However, my notes and articles are fucking objective (LOL). So, what the “robot” answered is in fact correct, even if I don’t like or follow that answer (I always err to the side of caution and use anti-seize). This is actually very good, and perhaps even more correct than I would answer, because I would have recommended anti-seize a bit more “aggressively” so to speak.

The full notes about my local AI setup:

https://io.bikegremlin.com/37912/self-hosted-no-docker-ai-lm-studio-anythingllm-setup/

1 Like