I would say that deleting user input would be a bug.
The way MP3tag behaves now leads to a valid format in the field and safeguards the user input.
You could instead find out how the invalid format got into the field in the first place and/or correct it before you add further lyrics.
See also this thread which describes why the pipe characters are now kept: