AI Assisted Q&A / Chatbot / Text Generation

I absolutely love this idea - it would really make the idea of a “second brain” more intuitive to use.

While AI-powered connections would be interesting, I’d like to have AI & NLP-powered search. In this way, one could search / ask Obsidian things like:

  • “What did I do last year in December” => and it shows a summary of my daily notes and important documents I created

  • “What are different ways of scaling Scrum?” => and Obsidian looks through my markdown notes to pull out the results that answer this

8 Likes

This was also my thought. I’ve been playing recently with some classic NLP approaches to build a note recommendation script for my note taking workflow. It employs fairly simple methods based on the token frequency modeling but gives promisingly good results in terms of recommended connections.

2 Likes

any update on this? Now that chat GPT is totally virial, i’ve been looking for something that i can ask my obsidian about stuff i already know. even a plugin that took open Ai’s APIs would be great.

working on poc for this with open AI API but probably I am not the only one and definitely I am not the one with the largest pile of spare time :smiley:

1 Like

Hells, I know this is a lot to ask, but just look at Notion AI.
This will be a great, difficult( and pricey) leap, but I believe this will be incredibly valuable.

Problem:
As my vault grows, it’s sometimes difficult to find quick answers to questions buried in notes. I know the answers are in there, but I apparently didn’t give enough context or keywords to make it easy to find. I know if GPT3.5 had access to all my notes, it could understand what I’m asking for, and find the note(s) that contain the answers.

Example:
I’m trying to remember what days I’m supposed to schedule certain meetings on. I know I have a note somewhere with that info, but search isn’t pulling it up quickly.

Propose Solution:

  1. Hit a hotkey and a prompt window pops up. I type “What days are reserved for strategy meetings?”
  2. My entire vault is previously indexed using OpenAI’s embeddings and/or LlamaIndex (formerly GPT-Index), so the plugin can quickly search the index, find relevant notes (and sections within notes), then send those snippets to OpenAI for summarization.
  3. The plugin then returns the answer: “Strategy meetings should be scheduled on the last Friday of each month.”
  4. The answer includes links to the source(s) where it found that information (the notes in my vault)

I’m no developer. I’ve been able to build a proof-of-concept in Javascript (thanks to Chat-GPT and a lot of Googling), but I don’t know how to turn it into an Obsidian plugin.

Anyone here find this idea valuable enough to develop?

5 Likes

Same Idea here! I am developing the plugin with langchain package which can act as Q&A robot.

After a while, our vaults will be filled with tens of thousands of notes, and there are more to come each day. These huge number of notes are impossible to process.

Suggested features include elementary one and advanced ones.
Elementary ones: auto attaching referenced sources(pdf, pics, graphs), adding tags, auto including relevant information, etc.

advanced ones: Auto-generating new information/content/ideas/connections based on current notes in the vault. This can be implemented by deploying machine learning methods, which was trained by existing books/courses/internet content.

9 Likes

This is dream :smiley: Google GPT-3… maybe later it will be possible.

2 Likes

I’ve been checking out some open source ai’s and I have a feeling that one of these may have the potentials you’re looking for.

2 Likes

Please let me know if any of those work out for you! :slight_smile:

This one looks promising for your specific needs.

Anyone out there is experimenting with these sorts of systems?

There are a lot of challenges about to scale a vault to thousands of notes.

Perhaps we can develop some sort of ‘lab’?

I have early access to this site, but I still to figure it out

Edit: I wasn’t active there and I lost access :frowning:

1 Like

Super interesting topic! I learned about Flowrite (Disclaimer: Referral link to get earlier access) | Flowrite yesterday that seems promising.

Also a fun discussion on HN about how AI like this is now ADDING fluff instead of reducing noise (and why that may be good, too).

3 Likes

From the same people: Open AI's GPT-3: How We Got Access in 5 Days :crazy_face:

1 Like

Guys, Thanks for all the suggestions. There are a lot to be done in this direction. But we can start with easy one, like some context-dependent automation and an elementary intelligent suggestion algorithms that can detect what you are doing and suggest some relevant things to you real time. This suggested sth may be sth new.

1 Like

I have access to GPT-3 and I’ve played around with it some. It would be interesting to see how it could fit into something like Obsidian.

3 Likes

I’m in! Building some ML stuff for my bookmarks right now and want to extend it to my notes at some point.

Anyone want to start simply and build a tag recommendation plugin (reads current note and connected notes and extracts import keywords)?

Hi @eagle what things you imagine ‘it’ suggesting?