I also think, this would be a huge feature, which is probably comparatively easy to implement.
This feature is basically already implemented via Files and links > Excluded Files. Maybe just copy this setting, name it Ignored Files and skip those files and directories altogether.
For large vaults this could mean a significant improvement.