No, I made a typical oversight:
In my regular installation, I defined additional file types in the options that should be displayed in MP3tag. However, in the portable installations I tested, I used MP3tag's default settings. This resulted in a difference, as external cover art files, among other things, were not displayed in MP3tag.
BTW I used Windows 11.