Introducing Obsidian AI Assistant: Your Gateway to AI Models in Obsidian Notes

Share & showcase
1

Hello Obsidian users!

I am excited to announce the release of a new plugin called “AI Assistant”. It enables seamless interactions with cutting-edge AI models, such as OpenAI ChatGPT, DALL·E2, and Whisper, directly from your Obsidian notes.

With Obsidian AI Assistant, you can now enjoy the following features:

  1. Text assistant with GPT-3.5 and GPT-4: Get access to two commands to interact with the text assistant, “Chat Mode” and “Prompt Mode”. Chat Mode allows you to discuss with the AI Chatbot from your Vault to generate content for your notes, while Prompt Mode lets you use selected text from your note as input for the assistant (for instance to summarize, format them, ask questions etc).
  2. Image generation with DALL·E2: Generate beautiful images for your notes with ease.
  3. Speech-to-text with Whisper: Dictate your notes with the Speech-to-Text command, and the transcript will be immediately added to your note at your cursor location.

The AI Assistant is also compatible with your mobile! I hope you will enjoy using the plugin and look forward to hearing your feedback!

Happy note-taking!

3 Likes
2

Would you be able to use a local LLM/Agent, like lama.cpp, in place of GPT?

The cost associated with using cloud-based LLMs is the thing keeping me from working with it.

3

Currently, there is no support for local models. I also would like to have that possibility in the future, but I am afraid that the response from the model will take too much time to arrive if you do not have powerful enough hardware, making it unusable in practice.

4

Good quality and fast (dependant on hardware of course) local and private LLMs are coming soon, weeks to months. They’re already available with technical skills. Plugins will be able to simply point to local or cloud models.

1 Like
5

I am super excited to see AI integration. One step closer to the AR AI assisted productivity suite that I always dreamed of :smiling_face_with_three_hearts:

Whilst the text capabilities are awesome, does the AI prompt have the capability to handle linking and backlinking?

For example:
“Could you show me all the nodes that mention the term ‘XYZ’”
“Could you link nodes that mention ‘XYZ’”

Being able to add / remove links and have deeper interface interaction with AI like this would be super helpful, especially for those with larger vaults that might need reorganising, but would otherwise be a pain to do manually.