There's two ways you could have interpreted that comment.

The first, is that this would have annoyed me, and been a factor, but not the factor, in deciding my vote.

The second, is that I would vote for the other guys out of spite.

You went with the big brain option.