Files aren`t removed

I assume that you know that Mp3tag always load the last used directory on startup?

You can change that behaviour in File -> Options -> Directories: Favorite directory and activated "start from this directory". If you choose a directory without music files or even a not existing directory, Mp3tag always starts with an empty list. Could this help?