286
submitted 1 year ago by L4s@lemmy.world to c/technology@lemmy.world

Teen boys use AI to make fake nudes of classmates, sparking police probe::Parents told the high school "believed" the deepfake nudes were deleted.

you are viewing a single comment's thread
view the rest of the comments
[-] otter@lemmy.ca 76 points 1 year ago* (last edited 1 year ago)

The other comment about how this has been happening for a long time (with low tech methods) is true, and it's also true that we can't stop this completely. We can still respond to it:

An immediate and easy focus would be on what they do with the images. Sharing them around is still harassment / bullying and it should be dealt with in the same way as it currently is.

There's also an education aspect to it. In the past, those images (magazines, photocopies, photoshop) would be limited in who sees them. The kids now are likely using free online tools that aren't private or secure, and those images could stick around forever. So it could be good to highlight that

  • Your friends and classmates may see them, and it may harm their lives. The images will likely stick around. Facial recognition algorithms are also improving, so it's a legitimate concern that an image stored on a random site somewhere will be tied back to them.
  • The images can be traced back to the creator and the creator can face repercussions for it (for those without empathy, this might be the better selling point
[-] Emma_Gold_Man@lemmy.dbzer0.com 23 points 1 year ago

Your point 1 seems to forget something important: kids are often cruel, and bullying is frequently the point. So long term consequences for their classmates can be an incentive more than a deterrent.

[-] Buddahriffic@lemmy.world 2 points 1 year ago

Yeah.

What teacher says: You shouldn't do this because it might hurt somebody.

What some kids hear: Check out this new way to hurt somebody and get horny at the same time. And as an added benefit, you can say it's only about the first one if admitting the second one would hurt you socially, even if the second one was the whole original point!

[-] Adalast@lemmy.world 15 points 1 year ago

To your first point, much to the benefit of humanity, and counter to popular belief, the internet is NOT forever. Between link rot, data purges, corporate buyouts, transmission compression losses, and general human stupidity, large swaths of the internet have vanished. Hell, just Macromedia selling out to Adobe ended up causing the loss of most of the popular internet games and videos for anyone in their mid to late 30s at this point (you will be misses Flash). The odds of these specific AI-generated child porn pictures surviving even in some dark corner of the bright web are slim to none. And if they end up surviving in the dark web, well, anyone who sees them will likely have a LOT of explaining to do.

Also, for the commentary of the websites keeping the images. That is doubtful, beyond holding them in an account-bound locker for the user to retrieve. They don't care and too many images get generated every day for them to see it as more than reinforcement training.

Speaking of reinforcement training, they may have been able to use Photoshop's new generative fill to do this, but to actually generate fresh images of a specific peer they would have had to train a LoRA or Hypernerwork on photos of the girl so the SD could actually resolve it. They weren't doing that on an AI site, especially not a free one. They were probably using ComfyUI or Automatic1111 (I use both myself). They are free, open source, locally executed software that allow you to use the aforementioned tools when generating. That means that the images were restricted to their local machine, then transferred to a cell phone and distributed to friends.

https://www.theatlantic.com/technology/archive/2021/06/the-internet-is-a-collective-hallucination/619320/

this post was submitted on 03 Nov 2023
286 points (96.1% liked)

Technology

59674 readers
1886 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS