ChatGPT does a great job of converting pictures of hand-written notes into markdown, with the prompt “Transcribe these notes into markdown for me”. This is a powerful ability that makes it much easier to consolidate notes into obsidian markdown. More generally, access to AI image interpretation for organizing information would be a powerful tool. It would be great to have a plugin that makes use of AI image interpretation within Obsidian.
Use case or problem
User story: I have paper notes, and I want to rapidly and neatly get that information into Obsidian. I want to take a picture of a page of my handwritten notes, and have it converted into nicely formatted markdown.
Proposed solution
Make a plugin with camera access, that takes a picture of the notes from within Obsidian, and feeds the image into an AI model (openAI/Anthropic) with the prompt “Transcribe this text into markdown”.
Current workaround (optional)
Using the ChatGPT or Anthropic app to take the picture and convert to markdown, then copy and paste the markdown into Obsidian.
Related feature requests (optional)
General ability to form Obsidian notes out of AI image interpretation without leaving the app.