How to make mp3tag forget last directory used?

Go to Options > Directories and tick "start from this directory" but leave "Favorite directory" blank.

This will make Mp3tag start with an empty file list.