Answering myself, I've found this
How to batch Im-/Export of Cover Art?
which solves part of my problem. Only thing is I'm still not clear how, having created an action to extract the cover, I can tell mp3tag to do it in bulk to the entire library (or, rather, to the first track in every folder), rather than just one at a time.