How do I remove the red X on the left side of Filename for some of my song names

Support
2

By using one of the fixing tools:

You can see the reason for the X error icon in the "Tag" column of that file in Mp3tag's File List.