Is there a way or a plugin that converts real time handwriting notes to automatically typed text?

Feature requests
1

Use case or problem

Is there a way or a plugin that converts real time handwriting notes to automatically typed text in obsidian-excalidraw?

My SetUp
MacBook Pro
Wacom Intuos Pen Tablet

I am frequently take notes while learning things online for which obsidian excalidraw is amazing.I am hoping to have a feature or script or button (something like ocr plugin in excalidraw) that converts the real time handwriting to typed text input.
I have seen this feature in ipad they have it called scribble effect.

Proposed solution

I have found the myscript technology(MyScript Developer) that converts handwritten notes to typed text input.
I am using there API’s and SDK

I have developed a script and added it as a script in obsidian excalidraw that connects to my server via websocket .However after connecting my server the input from excalidraw drawing (client) do not reach to my server where the my script API’s can return the response.

It would be super helpful and economical for students/enthusiasts who do not have budget to purchase ipad. Additionally it would be a breathtaking plugin in obsidian excalidraw this could be very amazing when writing or explaing one thought in real time to others removing the obtacle of typing and explaing.

Current workaround (optional)

Related feature requests (optional)

2

You might be interested in this open source project

Xournal++ HTR https://github.com/PellelNitram/xournalpp_htr

While many commercial note taking apps feature great HTR systems to make your notes searchable and there are a number of existing open-source implementations of various algorithms, there is no HTR feature available in an open-source note taking application that is privacy aware and processes your data locally.

The purpose of the Xournal++ HTR project is to change that!

Xournal++ HTR strives to bring open-source on-device handwriting recognition to Xournal++ as it is one of the most adopted open-source note taking apps and thereby HTR can be delivered to the largest possible amount of users.

Xournal++ Obsidian community plugin https://github.com/jonjampen/obsidian-xournalpp

A seamless integration with Xournal++. Xournal++ is an open-source and cross-platform note taking application for digital, handwritten notes and PDF annotations.

Features

  • Automatically export Xournal++ notes to PDF whenever they are modified, so that they can be linked, embedded, and viewed in Obsidian
  • Easily create new Xournal++ files (.xopp) directly from within Obsidian, accessible from the ribbon icon, file explorer, and command palette
  • Access the “Edit in Xournal++” option via an icon in the PDF preview as well as in file explorer (by clicking on X++), enabling quick navigation to the corresponding Xournal++ file.