How do I mass remove ID3v2 from a directory of mp3's?

If the program already displays data from ID3V2.3 tags (which it looks like) then the encoding could be the cause for the gibberish - see this thread on character encoding:
/t/2785/1