62
submitted 6 months ago by Stopthatgirl7@lemmy.world to c/news@lemmy.world

In 2023, more deepfake abuse videos were shared than in every other year in history combined, according to an analysis by independent researcher Genevieve Oh. What used to take skillful, tech-savvy experts hours to Photoshop can now be whipped up at a moment’s notice with the help of an app. Some deepfake websites even offer tutorials on how to create AI pornography.

What happens if we don’t get this under control? It will further blur the lines between what’s real and what’s not — as politics become more and more polarized. What will happen when voters can’t separate truth from lies? And what are the stakes? As we get closer to the presidential election, democracy itself could be at risk. And, as Ocasio-Cortez points out in our conversation, it’s about much more than imaginary images.

“It’s so important to me that people understand that this is not just a form of interpersonal violence, it’s not just about the harm that’s done to the victim,” she says about nonconsensual deepfake porn. She puts down her spoon and leans forward. “Because this technology threatens to do it at scale — this is about class subjugation. It’s a subjugation of entire people. And then when you do intersect that with abortion, when you do intersect that with debates over bodily autonomy, when you are able to actively subjugate all women in society on a scale of millions, at once digitally, it’s a direct connection [with] taking their rights away.”

you are viewing a single comment's thread
view the rest of the comments
[-] FlyingSquid@lemmy.world 8 points 6 months ago

Unfortunately, I don't know that there is much to be done at this point. Even if every form of deepfakery were outlawed in the U.S., people would just do it via another country that allows it. They could hide what they were doing with a VPN.

The only way to even come close to truly combating this would be an international treaty. And even then, I think it's highly unlikely to get all of the nations to sign on to it, so people would just do it via Belarus or something.

Even detection tools will not do the trick, because, just like with malware, it will be a never-ending battle between detection tools and the deepfakes' ability to avoid detection tools.

At best, we can stop the wound from gushing so much.

[-] magnusrufus@lemmy.world -4 points 6 months ago

Treat the problem like cp. There is plenty to be done at this point. Not being able to fix it 100% doesn't mean we shouldn't try to fix it at all.

[-] jkrtn@lemmy.ml 8 points 6 months ago

If someone completely independently generates and distributes pornography that ends up looking too much like a real person, and someone else downloads and keeps that image, should the downloader be prosecuted? That's what it's going to come down to, I think. If you want a law that requires intent, it will be too difficult to prove, and if you want a law that does not require intent, it may be a big overreach.

It's easier to write the law for CSAM because you have to be pretty fucked in the head to want to look at that in the first place. Making possession of it illegal isn't interfering with normal human activity.

[-] magnusrufus@lemmy.world 2 points 6 months ago

Those are pretty good concerns. Wonder if meta data about the model used and the prompt data could be required to address the issue of intent. I do think that accidental downloading would have to be an exception but if it's clearly labelled/advertised I think that downloading could still be targeted.

[-] jkrtn@lemmy.ml 1 points 6 months ago

Sure, but then that's a home run for every defense lawyer assigned to these. "Your honor, my client thought they were real photos she published," becomes a legitimate defense. "My client didn't realize a real person was involved at all, he thought the image was entirely fictitious." People publishing AI fakes aren't going to add exif data, and requiring meta data on AI generated images sounds like its own separate overreach.

[-] magnusrufus@lemmy.world 0 points 6 months ago

I'd say for the sake of not jailing the innocent that letting the ones that can plausibly deny beat the charges is what we'd have to accept. I think that requiring that meta data would certainly be a significant new requirement but it doesn't necessarily make it an overreach. I believe that pornography production has to provide verification of the age of their participants and every porn site has some legal statement about the age of the people depicted. Categorize the meta data requirements similarly.

load more comments (36 replies)
load more comments (38 replies)
this post was submitted on 09 Apr 2024
62 points (90.8% liked)

News

23190 readers
2897 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 1 year ago
MODERATORS