Just learned about the GPT4All project via Mozilla’s IRL Podcast: With AIs Wide Open
GPT4All is an open-source software ecosystem that allows anyone to train and deploy powerful and customized large language models (LLMs) on everyday hardware. Nomic AI oversees contributions to the open-source ecosystem ensuring quality, security and maintainability.
GPT4All software is optimized to run inference of 3-13 billion parameter large language models on the CPUs of laptops, desktops and servers.
There’s a number of ChatGPT3/4-based Obsidian plugins available, which I’ve avoided due to privacy and data protection concerns.
Data sharing can be disabled in GPT4All which can be used locally without an internet connection. It comes with a “LocalDocs Plugin” which is currently in Beta and is already powerful and able to query your own files in various document formats ( docx, PDF, txt, ePub … ) — though no summarization capabilities yet.
I’d love to see and use GPT4All-based plugins for text generation, auto-tagging and other tasks in my Obsidian vault.