Honestly, I find the entire system annoying and counter to fostering real discussions.
If you go to a party, it's not like people in the room have tags over their heads which say "trustworthy," "troll," "crazy," or whatever else. You have to make up your own mind based on your interactions and (hopefully) use of critical thinking to decide if someone you are talking with is worth your time.
If I don't want to take the time to read anything which might offend me, put me off, make me uncomfortable, challenge me, or just in some way be contrary to my world view then frankly, online forums would not be the spaces in which I would be reading things.
I believe that everyone has a point of view that can have value in some way, if only to illustrate that "negative" or "contrary to me" view and people exist around me. They have voices to contribute. Deciding if their contributions are valuable enough to award them a positive or negative "Reputation" is not an abstract thing. A true reputation takes time to build in the real world. It is earned for better or for worse, by actions people take over time not by some arbitrary number farmed by a bot posting cat memes 24/7 or whatever, or posting viewpoints sure to garner upvotes because like minded people are the only ones replying.
That's fair. My view still is that such replies are easy to spot, so they don't pose as big of an issue as might seem.