99
submitted 2 weeks ago by Pro@reddthat.com to c/technology@lemmy.world

Schools and lawmakers are grappling with how to address a new form of peer-on-peer image-based sexual abuse that disproportionately targets girls.

(page 2) 50 comments
sorted by: hot top controversial new old
[-] Regrettable_incident@lemmy.world 2 points 2 weeks ago

Aren't there already laws against making child porn?

load more comments (2 replies)
[-] RememberTheApollo_@lemmy.world 2 points 2 weeks ago* (last edited 2 weeks ago)

I’m sure the laws will focus on protecting IP - specifically that of AI companies or megacorps, the famous and powerful, but not the small creators of content or the rabble negatively affected by AI abuse.

The rest of us will have to suffer through presenting whatever damaging and humiliating video to a court. If you can even afford a lawyer to do so. Then be offered a judgement that probably won’t be paid or won’t cover the damage done by an image that will never be able to be erased from the internet. Those damages could include the suicide of young people bullied and humiliated by such deepfakes.

[-] PumpkinEscobar@lemmy.world 1 points 2 weeks ago

If kids want to be protected they need to get some better lobbyists. /s

[-] LovableSidekick@lemmy.world 1 points 2 weeks ago

Instead of laws keeping up It also might turn out to be a case where culture keeps up.

[-] mhague@lemmy.world 1 points 2 weeks ago

So is this a way to take away rights by making it about kids?

I mean what the fuck. We did much less and got punished right? It didn't matter if we were on the property. Schools can hold students accountable for conduct with other students.

The leaded-gas adults of the time had no problem dealing with the emergence of cell phones. It was a distraction. They didn't need lawmakers to call it something specific. My Pokemon cards caused fights and were banned. No lawmakers needed.

The problem is surely with the interaction between parents and schools. Or maybe it's just the old way of thinking. Maybe it's better to have police and courts start taking over discipline in schools.

[-] danciestlobster@lemmy.zip 1 points 2 weeks ago

I don't understand fully how this technology works, but, if people are using it to create sexual content of underage individuals, doesn't that mean the LLM would need to have been trained on sexual content of underage individuals? Seems like going after the company and whatever it's source material is would be the obvious choice here

[-] lime@feddit.nu 2 points 2 weeks ago* (last edited 2 weeks ago)

not necessarily. image generation models work on a more fine-grained scale than that. they can seamlessly combine related concepts, like "photograph"+"person"+"small"+"pose" and generate plausible material due to the fact that all of those concepts have features in common.

you can also use small add-on models trained on very little data (tens to hundreds of images, as compared to millions to billions for a full model) to "steer" the output of a model towards a particular style.

you can make even a fully legal model output illegal data.

all that being said, the base dataset that most of the stable diffusion family of models started out with in 2021 is medical in nature so there could very well be bad shit in there. it's like 12 billion images so it's hard to check, and even back with stable diffusion 1.0 there was less than a single bit of data in the final model per image in the data.

load more comments (6 replies)
[-] warm@kbin.earth 1 points 2 weeks ago

The laws to ban "AI", you mean?

[-] SabinStargem@lemmy.today 1 points 1 week ago

Deepfakes might end up being the modern version of a bikini. In the olden days, people wore these to the beach. Having less was scandalous and moral decay. Yet, now we wear much less.

Our grandchildren might simply not give a damn about their nudity, because it is assumed that everyone is deepfaking everyone.

load more comments (2 replies)
load more comments
view more: ‹ prev next ›
this post was submitted on 02 Jul 2025
99 points (98.1% liked)

Technology

72869 readers
1586 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related news or articles.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, this includes using AI responses and summaries. To ask if your bot can be added please contact a mod.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS