If MP3tag apparently does not delete tags then you should check which tags you let Mp3tag read, write and delete.
The proper setting would be: read and delete all, write only V1 and V2.
Esp. APE tags are a problem.
If you have these in a file, get rid of them.
If this is not the case, check the file's integrity with mp3val and/or mp3diags.