How do I theme my callout boxes/admonitions?

Hi! I just want to theme my callout boxes because I want them plainer - the default blue/purple/etc is nice, but I’m using a different theme. Is this not yet a feature or am I doing it wrong?

I’m aware I can do it via CSS, but that seems a tad technical and I just wanted to use a Theme.