Bots most likely. People creating many accounts on the more open signup servers, then running local bots that mass downvote certain users.

Downvote bots are IMO the current biggest spam vector on lemmy. Unlike posts / comments, its harder to detect that its a bot / AI doing it.

The next lemmy version will have the option to disable federated downvotes, which will make them all moot.