If you create a new Folder in the vault, then right click on it and select “Set as attachment folder” it stores attachments in that folder, without cluttering the main structure.
TBH, I’m not sure if existing attachments will be moved to the new folder though. And if dragging and dropping the attachments into the new folder will update existing links.