I don't know if this is really a bug, but I was able to uninstall the program while it was running. Afterwards the program wouldn't close and the log file wan't saved.
Never tried that, thanks for pointing. I'll change it to the next release.
On a sidenote: you don't need to uninstall Mp3tag before installing a new version.