Putting this here if it helps anyone (and in case I get good corrections or tips):
I wanted to make use of AI to extract information from all the data in my Obsidian notes - and on my websites. Private, offline, and if possible, free and simple to set-up.
So, I made a local LLM work on my Windows PC, using (for now still) free software, and no Docker.
As simple and idiot-friendly as it gets.
DeepSeek wrote a well-functioning WordPress website scraper, so I could feed all my public knowledge (from my websites) - along with my private Deathnotes.
Here is an example:
Why is this impressive? Because I’m a huge fan of anti-seize mounting pastes and use them on practically every bolt! However, my notes and articles are fucking objective (LOL). So, what the “robot” answered is in fact correct, even if I don’t like or follow that answer (I always err to the side of caution and use anti-seize). This is actually very good, and perhaps even more correct than I would answer, because I would have recommended anti-seize a bit more “aggressively” so to speak.
The full notes about my local AI setup:
https://io.bikegremlin.com/37912/self-hosted-no-docker-ai-lm-studio-anythingllm-setup/