Music App and Covers

Yes, UpdateTagInfo mentioned by @MotleyG seems to be for Windows only.

On the Mac, I'm using a very simple script which you can use with the Script Editor.app on macOS:

tell application "Music"
	set sel to selection
	if sel is {} then return
	repeat with aTrack in sel
		if class of aTrack is file track then refresh aTrack
	end repeat
end tell

You can run it while having the tracks to be reloaded selected in Music.app.

I think it was inspired by Doug's AppleScripts, but I can't find the correct source anymore.