Are you loading Tag Sources with your whole library selected?
The feature works on a per-album level, so you usually use Tag Sources only with a couple of files that belong to a certain release (and not hundreds of files at once).
Please see this topic for a description of the general process: