JPEG scales from excellent quality down to rubbish. For good fidelity when viewing small images on screen, chroma subsampling must be disabled. Else colorful elements, mainly red but also saturated blue will be smeared, which is a common complaint about JPEG. Subsampling will also lead to high generation loss when the image is repeatedly saved, which sometimes can't be avoided. Even if it already has smeared reds, you should not use subsampling to not reduce quality further.
You might only notice a quality degradation on artificial images containing smooth gradients and no noise. Such images should be saved in PNG format. Sometimes dithering noise can be added. For example, look at the artwork for Tony Carey's "Christmas Hymns".
The compression ratio depends a great deal on how much detail there is in the picture. Cover artwork often has a lot of detail crammed into a small space. Scanned artwork may contain remains of the halftone pattern used in printing to simulate intermediate colors or noise, which cannot be compressed without loss.
Take, for example, the artwork of Maroon 5 - "Overexposed". It contains many transitions between highly saturated segments. At high resolutions such image might have a higher proportion of blocks of a similar color and would compress better. But around at a width of 1000px, almost every block contains a sharp transition and needs a lot of data to represent it accurately.
An image such as Alicia Keys - "Girl on Fire" can have a high compression. Most of it is in greyscale and contains low level of noise.
When you download artwork from the Web, it is usually already transcoded from a moderately compressed format. Everything on the Web passes servers that do transcoding. Once the details have been discarded by the encoder, the image will save to a smaller size than a high quality copy, particularly if the encoding blocks haven't shifted because no cropping or resizing has been done.
You can obtain good quality artwork using the iTunes Artwork Finder, which can access the original quality of releases submitted to mainstream digital distributors. Notice that the files can be quite small even if they come at 100 quality, and show some artifacts at high zoom level.
Fanart TV have settled on 1000*1000 px size, which I also use in my collection. At good quality the images are 600 to 1024 kB. They take 2.86 MB uncompressed in memory. A bigger image can be included with the music in a way that doesn't cause media players to display it automatically.
Linear JPEG takes the least amount of processor to decode. Progressive JPEG and PNG are about twice as slow. Other formats are several tiles slower. JXL can have variable complexity. WebP in lossy mode always has chroma subsampling(!). JPEG-2000 and JPEG with arithmetic coding is an order of magnitude slower to decode. Video-derived formats AVIF and HEIF are extremely slow. This may be important for booklet scans that need to bigger to be readable.