341

A Telegram user who advertises their services on Twitter will create an AI-generated pornographic image of anyone in the world for as little as $10 if users send them pictures of that person. Like many other Telegram communities and users producing nonconsensual AI-generated sexual images, this user creates fake nude images of celebrities, including images of minors in swimsuits, but is particularly notable because it plainly and openly shows one of the most severe harms of generative AI tools: easily creating nonconsensual pornography of ordinary people.

you are viewing a single comment's thread
view the rest of the comments
[-] echo64@lemmy.world 0 points 7 months ago

Every time this comes up, all the tech nerds here like to excuse it as fine and not a bad thing at all. I am hoping this won't happen this time, but knowing lemmys audience...

[-] sbv@sh.itjust.works 10 points 7 months ago

The Lemmy circlejerk is real, but excusing deep fake porn is pretty off brand for us. I'm glad the comments on this post are uniformly negative.

[-] echo64@lemmy.world 7 points 7 months ago* (last edited 7 months ago)

https://sh.itjust.works/comment/10397565

https://kbin.social/m/technology@lemmy.world/t/927248/-/comment/5921190 just accept it as a new normal, it's fine. Can't possible have any recourse, just accept it women of the world, it's the new normal!

[-] sbv@sh.itjust.works -1 points 7 months ago

Okay, there are a couple of douche canoes, but generally speaking, I think we're okay on this one.

[-] echo64@lemmy.world 1 points 7 months ago

It is massively upvoted (for lemmy).

[-] roscoe@lemmy.dbzer0.com 9 points 7 months ago

I think part of the difficulty discussing this is the discussions usually combine two different things. The production and distribution.

I was informed elsewhere in this thread people can already produce these images/videos on their own machines with no third parties involved or remote processing. I can't think of a single thing that can be done about that so acceptance is all we've got.

Nonconsensual sharing, on the other hand, we can and should do something about. The legal system won't be able to stop it altogether but it can push it to the fringes and stop it from becoming mainstream so any victims wouldn't see fake images/videos of themselves proliferating everywhere.

[-] cley_faye@lemmy.world 3 points 7 months ago

It's not a matter of excusing it. Distribution of someone's picture without their explicit consent, and anything like that, is inexcusable. But we're talking about the generation of said content, which technically can't be stopped without seriously restraining everything.

[-] Thorny_Insight@lemm.ee 1 points 7 months ago

I'm not saying it's not a bad thing but it's inevitable. The problem will just be getting worse and there's no stopping it. It's something we're just going to need to accept as a new normal. If we can deal with living under the constant threat of nuclear armageddon then I think we can live with fake nudes aswell.

[-] echo64@lemmy.world 15 points 7 months ago

Yeah it's this shit I'm talking about. We have a whole legal and justice system to deal with this. No kne needs to accept sexual abuse as a new normal. This shit is weird.

[-] Thorny_Insight@lemm.ee 5 points 7 months ago* (last edited 7 months ago)

I'm not saying there shouldn't be consequences for someone who is spreading these pictures with the intention to cause harm to someone's reputation but it's incredibly naive to think that the justice system is going to stop deepfakes when it can't even prevent bike theft. 12 year olds are making these with their smartphones. The technology is extremely accessible and easy to use and that is not going to change. I'm sorry but you're not putting the toothpaste back into the tube. Wait a few years and you can generate photorealistic porn videos of anyone you want.

[-] echo64@lemmy.world -3 points 7 months ago

We can't stop biketheft so fuck off women, your free game coz this guy said so.

[-] Thorny_Insight@lemm.ee 1 points 7 months ago

When you start strawmanning you've already lost the argument.

[-] echo64@lemmy.world -2 points 7 months ago

You might want to look up what strawmanning means. I'm just flat out mocking what you said.

[-] Dkarma@lemmy.world 0 points 7 months ago

No we don't. What is happening here is not covered by current laws.

this post was submitted on 29 Mar 2024
341 points (93.4% liked)

Technology

59583 readers
2245 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS