Old Topics. But my personal solution is to use a callout for figure. One has to scarify a standard callout or custom one. Here after I use tip:
> [!tip] ![[my_figure.png]]
> *This is the caption*
With some css leverage you can customise Icon and Title specific for tip (in this example) callout.
I wish Obsidian can support some [!figure] [!table] [!math] callout natively.
With this trick you can also make a collapsible bigger figure with caption :
> [!tip]- ![[my_figure.png|100]]
> ![[my_figure.png]]
> *This is the caption*