Is there any counter AI bots in the fediverse (lemmings.world)

submitted 1 month ago by PixelPilgrim@lemmings.world to c/fediverse@lemmy.world

9 comments fedilink hide all child comments

cross-posted from: https://lemmings.world/post/21993947

Since I suggested that I'm willing to hook my computer to an LLM model and to a mastodon account, I've gotten vocal anti AI sentiments. Im wondering if fediverse has made a plug in to find bots larping as people, as of now I haven't made the bot and I won't disclose when I do make the bot.

top 9 comments

sorted by: hot top controversial new old

[-] TootSweet@lemmy.world 8 points 1 month ago* (last edited 1 month ago)

What would the "bot that finds bots larping as people" do exactly? Ban them? Block or mute them? File reports? DM an admin about them?

If it's just for pointing out suspected LLM-generated material, I think humans would be better at that than bots would be, and could block, mute, or file reports as necessary.

Also, are you saying you intend to make a bot that posts LLM-generated drivel or a bot that detects LLM-generated drivel?

[-] PixelPilgrim@lemmings.world 1 points 1 month ago

At minimum flag them. Think about an Amazon review but that detects fact reviews or sponsor block. Make a database and the elements that are their post get eliminated.

I'll see if people can pick up on bots. If they can see if they do any on that.

I won't exactly say what I intend but it will involve LLM

[-] Lazycog@sopuli.xyz 6 points 1 month ago

Please don't create a bot account that is not flagged as a bot. There is enough malicious activity that you might not see because mods/admins are doing their job.

There is no need to increase the volunteer work these people do.

[-] JustAnotherKay@lemmy.world 5 points 1 month ago

Forcing the Fediverse into your experiment isn't going to get you into the position you think it will be the way

[-] hisao@ani.social 5 points 1 month ago

What I would expect to happen is: their posts quickly start getting many downvotes and comments saying they sound like an AI bot. This, in turn, will make it easy for others to notice and block them individually. Other than that, I've never heard of automated solutions to detect LLM posting.

[-] PixelPilgrim@lemmings.world -4 points 1 month ago

Ahhhhh I doubt average Lemmy users are smart enough to detect LLM content. I already thought of a few ways to find LLM bots

[-] hisao@ani.social 2 points 1 month ago

Imo their style of writing is very noticeable. You can obcure that by prompting LLM to deliberately change that, but I think it's still often noticeable, not only specific wordings, but higher-level structure of replies as well. At least, that's always been the case for me with ChatGPT. Don't have much experience with other models.

[-] hendrik@palaver.p3x.de 4 points 1 month ago* (last edited 1 month ago)

Lemmy and Fediverse software have a box to tick in the profile settings. That shows an account is a bot. And other people can then choose to filter them out or read the stuff. Usually we try to cooperate. Open warfare between bots and counter-bots isn't really a thing. We do this for spam and ban-evasion, though.