[Plug-in] Clipboard Tools: Optimize clipboard images in WEBP/AVIF format, leverage AI models convert them to Markdown/LaTeX

Share & showcase
1

I have written a plug-in to optimize images pasted from the clipboard, converting them to WEBP, AVIF, PNG, or JPEG. It also leverages AI models (Anthropic, Google, Mistral) to convert images to Markdown/LaTeX and summarize text.

https://github.com/albrtontheislnd/clipboard-tools

Supports WEBP, PNG, and JPEG using native encoding capabilities (Offscreen Canvas). Supports AVIF by calling external ffmpeg/ImageMagick/libvips binaries.

Features:

  1. Optimizing Images: right-click and select “Clipboard: Embed optimized WEBP/AVIF/PNG/JPEG” (or use the command palette). The optimized image will be embedded in your note.

  2. Converting Images to Markdown/LaTeX: In an Obsidian editor, right-click and select “Clipboard: Convert to Markdown”. A modal will appear displaying the converted Markdown/LaTeX. Choose whether to include the original image as well.

  3. Summarizing Text: Select the text you want to summarize. In the Obsidian editor, right-click and select “Clipboard: Summarize text”. The summarized text will be inserted below the original selection.

The plug-in is still in the development stage:

  • AVIF conversion relies on external programs and might not work on all systems. I haven’t tested it on Windows yet.
  • You need your own API keys to use AI-related features.
2

Sounds good.

Converting Images to Markdown means OCR-ing images? Adding an alternative to Taskbone OCR is a good idea.

3

The mechanism behind converting clipboard image to Markdown/LaTeX in my plug-in is simply about using a multimodal AI model to process. So, you cannot do this offline. Currently, I tested with Google’s Gemini and Anthropic’s Claude, and their produced results are excellent. You can obtain an API key with free limits (enough for daily use) from Google AI studio and test it.