567
submitted 2 months ago* (last edited 2 months ago) by Buttflapper@lemmy.world to c/technology@lemmy.world

Social media platforms like Twitter and Reddit are increasingly infested with bots and fake accounts, leading to significant manipulation of public discourse. These bots don't just annoy users—they skew visibility through vote manipulation. Fake accounts and automated scripts systematically downvote posts opposing certain viewpoints, distorting the content that surfaces and amplifying specific agendas.

Before coming to Lemmy, I was systematically downvoted by bots on Reddit for completely normal comments that were relatively neutral and not controversial​ at all. Seemed to be no pattern in it... One time I commented that my favorite game was WoW, down voted -15 for no apparent reason.

For example, a bot on Twitter using an API call to GPT-4o ran out of funding and started posting their prompts and system information publicly.

https://www.dailydot.com/debug/chatgpt-bot-x-russian-campaign-meme/

Example shown here

Bots like these are probably in the tens or hundreds of thousands. They did a huge ban wave of bots on Reddit, and some major top level subreddits were quiet for days because of it. Unbelievable...

How do we even fix this issue or prevent it from affecting Lemmy??

(page 2) 50 comments
sorted by: hot top controversial new old
[-] profdc9@lemmy.world 10 points 2 months ago

If they don't blink and you hear the servos whirring, that's a pretty good sign.

load more comments (1 replies)
[-] conciselyverbose@sh.itjust.works 10 points 2 months ago

The problem with almost any solution is that it just pushes it to custom instances that don't place the restrictions, which pushes big instances to be more insular and resist small instances, undermining most of the purpose of the federation.

[-] Hackworth@lemmy.world 9 points 2 months ago
load more comments (2 replies)

leading to significant manipulation of public discourse

Pretending that this wasn't already a massive issue on places like reddit since years ago, with or without bots, is a little bit disingenuous.

[-] AnotherWorld@lemmy.world 9 points 2 months ago

No current social network can be bot-proof. And Lemmy is in the most unprotected situation here, saved only by his low fame. On Twitter, I personally have already banned about 15000 Russian bots, but that's less than 1% of the existing ones. I've seen the heads of bots with 165000 followers. Just imagine that all 165000 will register accounts on Lemmy, there is nothing to oppose them. I used to develop a theory for a new social network, where bots could exist as much as he want, but could not influence your circle of subscriptions and subscribers. But it's complicated...

[-] tal@lemmy.today 7 points 2 months ago

Also, the "bot"/"human" distinction doesn't have to be binary. Say one has an account that mostly has a bot post generated text, but then if it receives a message, hands it off to a human to handle. Or has a certain percentage of content be human-crafted. That may potentially defeat a lot of approaches for detecting a bot.

[-] Jimmycakes@lemmy.world 9 points 2 months ago

You don't.

You employ critical thinking skills in all interactions on the web.

[-] Alpha71@lemmy.world 9 points 2 months ago

Ban them all.

[-] UndercoverUlrikHD@programming.dev 8 points 2 months ago

A chain/tree of trust. If a particular parent node has trusted a lot of users that proves to be malicious bots, you break the chain of trust by removing the parent node. Orphaned real users would then need to find a new account that is willing to trust them, while the bots are left out hanging.

Not sure how well it would work on federated platforms though.

[-] gandalf_der_12te@lemmy.blahaj.zone 9 points 2 months ago

I don't think that would work well, because I knew no one when I came here.

load more comments (1 replies)
[-] jimmy90@lemmy.world 8 points 2 months ago* (last edited 2 months ago)
[-] Kbobabob@lemmy.world 6 points 2 months ago
[-] CluckN@lemmy.world 9 points 2 months ago

Making them multiply prime numbers.

load more comments (1 replies)
load more comments (16 replies)
[-] Ensign_Crab@lemmy.world 7 points 2 months ago

How do we even fix this issue or prevent it from affecting Lemmy??

Simple. Just scream that everyone whose opinion you dislike is a bot.

[-] P1nkman@lemmy.world 7 points 2 months ago

I disagree with this statement, so Ensign_Crab must be a bot. Reported.

load more comments (2 replies)
[-] db0@lemmy.dbzer0.com 7 points 2 months ago

For example, a bot on Twitter using an API call to GPT-4o ran out of funding and started posting their prompts and system information publicly.

While there's obviously botspam out there, this post is clearly a fake as anyone with the programming experience will notice immediately. It's just engagemeb bait

load more comments (1 replies)
[-] LarmyOfLone@lemm.ee 7 points 2 months ago* (last edited 2 months ago)

Fundamentally the problem only has temporary solutions unless you have some kind of system that makes using bots expensive.

One solution might be to use something like FIDO2 usb security tokens. Assuming those tokens cost like 5€. Instead of using an email you can create an account that is anonymous (assuming the tokens are sold anonymously) and requires a small cost investment. If you get banned you need to buy a new fido2 token.

PS: Fido tokens still cost too much but also you can make your own with a raspberry pico 2 and just overwrite and make a new key. So this is no solution either without some trust network.

[-] MehBlah@lemmy.world 7 points 2 months ago

You were targeted by someone and they used the bots to punish you. It could have been a keyword in your posts. I had some tool that would down vote any post where I used the word snowflake. I guess the little snowflake didn't like me calling him one. I played around with bots for a while but it wasn't worth it. I was a OP on several IRC networks back in the day and the bots we ran then actually did something useful. Like a small percentage of reddit bots.

load more comments (10 replies)
[-] Dark_Arc@social.packetloss.gg 7 points 2 months ago

I've been thinking postcard based account validation for online services might be a strategy to fight bots.

As in, rather than an email address, you register with a physical address and get mailed a post card.

A server operator would then have to approve mailing 1,000 post cards to whatever address the bot operator was working out of. The cost of starting and maintaining a bot farm skyrockets as a result (you not only have to pay to get the postcard, you have to maintain a physical presence somewhere ... and potentially a lot of them if you get banned/caught with any frequency).

Similarly, most operators would presumably only mail to folks within their nation's mail system. So if Russia wanted to create a bunch of US accounts on "mainstream" US hosted services, they'd have to physically put agents inside of the United States that are receiving these postcards ... and now the FBI can treat this like any other organized domestic crime syndicate.

load more comments (13 replies)
[-] AsudoxDev@programming.dev 6 points 2 months ago* (last edited 2 months ago)

You can't get rid of bots, nor spammers. The only thing is that you can have a more aggressive automated punishment system, which will unevitably also punish good users, along with the bad users.

load more comments
view more: ‹ prev next ›
this post was submitted on 05 Sep 2024
567 points (96.2% liked)

Technology

59598 readers
2192 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS