Only a small part of the readings need to be reviewed. There is a reason to keep track only what needs to be reviewed. Not everything that is read should be noted. Bad readings must be forgotten. Not every bad one, but most of them.
No need to keep note of annoying annotators.