One thing that still grates with me is a lot of the vocals; a lot of the time, the vocalist can't keep a tune, and ends up changing the vocal melody. (Future 3,s version of Alison suffers from this, with the thin, German-accented vocals hitting phantom notes not in the original, not to mention words not in the original, which is somewhat distracting.) Which makes a lot of the tracks less covers of existing songs as different pieces of music that happen to borrow words and some elements from the original.
OTOH, with this as precedent, that Field Mice cover I put together is perhaps more excusable.