Past files that I worked on re-appears when I start new mp3tag

In its standard configuration, Mp3tag loads whichever directory was loaded in the previous session.

If you want to use another fixed (and possibly empty) directory as a startup directory for Mp3tag, you can configure a favorite directory at "Options > Directories" and enable the "start from this directory" checkbox.