If there was a team of downvoters following him around, then the number of downvotes he receives would be more consistent across his content, with older things having more and newer things having fewer.

Instead what we see is wildly varying downvote totals, seeming to depend on the specific thing he says. People disagreeing with his statements would not fuel his victimhood mentality though.

Personally I do check his account once a day to keep tabs on him. I don't generally downvote though, I prefer to fact check his statements.