I’ve had the same thing happen to me, very annoying and required extra time removing duplicate tracks from my music library.
My solution for now is to move music files and folders to a separate folder and have Hazel automagically open Music and import the tracks for me. I actually have two Hazel rules, one to do the import and another to clean up anything left behind.