120
submitted 6 months ago by MicroWave@lemmy.world to c/news@lemmy.world

The creation of sexually explicit "deepfake" images is to be made a criminal offence in England and Wales under a new law, the government says.

Under the legislation, anyone making explicit images of an adult without their consent will face a criminal record and unlimited fine.

It will apply regardless of whether the creator of an image intended to share it, the Ministry of Justice (MoJ) said.

And if the image is then shared more widely, they could face jail. 

A deepfake is an image or video that has been digitally altered with the help of Artificial Intelligence (AI) to replace the face of one person with the face of another.

top 48 comments
sorted by: hot top controversial new old
[-] BurningnnTree@lemmy.one 34 points 6 months ago

She said it "will only criminalise where you can prove a person created the image with the intention to cause distress", and this could create loopholes in the law.

This sounds like it would be almost impossible to prove. Anyone can just say "I made the deepfake porn because it turns me on, and I shared it online because I thought other people would enjoy it too." This law is a good start but I don't think it goes far enough.

[-] HexesofVexes@lemmy.world 29 points 6 months ago

This is a tricky one - it's a law that's setting out to protect folks, but it's also laying some dangerous groundwork.

[-] BreakDecks@lemmy.ml 5 points 6 months ago

Can you explain more on that? This sounds perfectly reasonable to me.

[-] HexesofVexes@lemmy.world 28 points 6 months ago

So, the basis of this law is a person's facial/physical parameters were used to make vulgar videos/images. This caused them distress, and so this is illegal. At this point, it is aiming to protect people from something deemed traumatic, and the law specifically requires the intent to be "to distress". It's a good law.

Let's say someone hand draws a vulgar image using my physical parameters that I find distressing. Is that illegal? At the moment, no, however it's not too great a step to see it pushed through by a similar argument (what if the artist was REALLY good, and they intended to distress me). And from here we go...

What about a cartoon or caricature? Could someone draw an image of the UK PM performing oral sex to billionaires and fall afoul if the subjects find it distressing? Surely such a cartoon cannot help but intend to dismay or distress the subjects?

Does it have to be vulgar or just cause distress? Could they just mock a person using an image? Mockery certainly sums to distress?

Does it have to be an image, or are distressing written pieces also viable?

It shifts towards the idea that "artistic" creations that provoke distress to an individual ought to be illegal. This is a viewpoint I stand strongly against.

However, this law is groundwork. Groundwork can also push towards a lot of good. Then again, how much do you trust UK politicians to make informed internet laws?

[-] BreakDecks@lemmy.ml 3 points 6 months ago

You make good points. I think applying the law differently based on whether the victim was a private person or a public figure (much in the way libel/slander laws do - at least in the USA) would be a good measure to ensure that free speech is preserved, while innocent people are protected.

Might not be so easy in the UK, I can't say I know a lot about the application of the law in this regard. Though given the Horizon scandal, I definitely lean towards not trusting UK politicians to make informed laws regulating computers...

[-] HexesofVexes@lemmy.world 3 points 6 months ago

That may be a good compromise, though it does provoke the question as to how public a figure one must be before one waives the right to not have malice directed at them.

I think my main qualm is that well meaning laws can often set a precedent for unforseen issues down the road, and the curtailment of any liberty, no matter how vile that liberty is, must be done with care to avoid creating traps for the future. Something UK politicians are famous for failing to do (our digital safety laws are very much responsible for our lack of privacy, and have created some of the most dangerous data troves on the planet!).

It just feels like the wrong approach to me.

Who is to say an image depicts whatever person. Sure a court / jury can try to decide, but I suspect that it's possible to make deepfakes look enough like the victim to do the damage, while dissimilar enough that there's reasonable doubt that the depiction was intended to represent the victim.

I feel like society needs to adapt to this. To me, in the age of deepfakes, there shouldn't be any shame in being depicted in a video, rather the people sharing it and watching it.

Like if someone said they saw a naughty video of me, I don't really see why I should be ashamed, but I world ask them what the hell they're doing watching it.

[-] Woozythebear@lemmy.world 0 points 6 months ago

It's not about shame.. like wtf? People's careers can be affected. In a day and age where corporations request access to all your social media and do extensive background/social media checks it's likely they may stumble upon a deep fake porn video of you and refuse to hire you over it.

Teachers are being fired for having only fans, what do you think is gonna happen when deep fake porn videos of teachers start to pop up and parents start demanding the teacher be fired?

Ok, semantics. "Shame" may not be the best word for it but it's the best I can think of.

Not as in "I feel ashamed about this video" but rather people thinking you ought to feel ashamed.

In a day and age where [...]

In a soon to be day and age where you can tell your VR goggles "show me a video of that person at the library today", we shouldn't be judging that person at the library.

[-] tsonfeir@lemm.ee 17 points 6 months ago

So, what if they just use photoshop?

[-] WamGams@lemmy.ca 17 points 6 months ago

I would assume unconsensual porn itself is the issue, not the program.

[-] tsonfeir@lemm.ee 11 points 6 months ago

Well, depends on the verbiage of the law. Lawmakers aren’t always very good at writing them.

[-] WamGams@lemmy.ca 3 points 6 months ago

I would be happy with the verbiage including anything that strips a person of consent.

[-] GrymEdm@lemmy.world 15 points 6 months ago* (last edited 6 months ago)

For anyone interested in the science, here's a video from Harvard psychiatrist/instructor Dr. K from HealthyGamerGG going over research on non-consensual pornography (deepfakes, revenge porn, and the like). The most impactful point he makes is, "After non-consensual pornography is released over half of the people who are involved want to kill themselves". There's a few minutes more of content for those who want to watch, including talking about increased rates of depression, anxiety, PTSD, etc., especially when the porn goes public.

I'll admit I used to look at deepfake porn, but I stopped immediately after hearing that and the rest of that video. Not because religion or society disapproves but because I want my entertainment to be consensual and fun - not so destructive that it makes the unwilling participants suicidal more often than not. I think there are ways to do porn properly that involve worker protections, respect, and of course consent. So I think this statute has a pretty solid foundation in severe harm reduction as per the research.

[-] MagicShel@programming.dev 5 points 6 months ago

I think it's harmless to generate and enjoy deepfake porn for your private consumption. I don't do it because I like my nude women to have ten fingers and toes.

[-] WamGams@lemmy.ca 5 points 6 months ago

I'm not sure I buy that argument.

There is enough pornography to last you until the heat death of the universe. The only reason you would create your own pornography with people who never consented is because the transgression itself is what is giving the sexual pleasure, not the pornography.

[-] MagicShel@programming.dev 8 points 6 months ago

Enjoying something for its transgressive nature doesn't make something necessarily bad. Neither does that make everything okay, I'm just saying there is nothing inherently wrong with enjoying the transgressiveness of an act more than the act itself.

But this is highly philosophical and any attempt to seriously explain my thoughts (and I made three attempts before just going with this) quickly gets too long, so hopefully we can just agree that there's room for respectful disagreement.

[-] WamGams@lemmy.ca -1 points 6 months ago

No, I don't think there is room for respectful disagreement when one of us is arguing they don't require sexual consent.

[-] MagicShel@programming.dev 9 points 6 months ago

No one consents to featuring in private fantasies.

[-] WamGams@lemmy.ca -3 points 6 months ago

A private fantasy is a thought. Creating unconsensual pornography is an action.

The longer this conversation continues, the higher your ick factor gets.

[-] MagicShel@programming.dev 5 points 6 months ago

Masturbating is an action, too. What's the qualitative difference between a private image in one's head and one on a screen?

You seem to struggle with separating a philosophical conversation from whatever icks you. If it assuages your sensibilities I don't engage in this activity, but only because it's not arousing to me in any way. I just can't see any actual difference between a fake image in your head and an equally private image on a screen.

When an image becomes public or harassing I think there is a clear problem. If you want to disagree on where the line is between an image in your head and one used to harm someone, that's fine. Neither of us is drafting a law here so it's all just wind and words. Have a good day.

[-] WamGams@lemmy.ca 1 points 6 months ago

An image in your head isn't a physical product that exists in the material world.

[-] MagicShel@programming.dev 2 points 6 months ago

Neither is an image projected onto a screen.

[-] WamGams@lemmy.ca -1 points 6 months ago

No, if you create something it exists, whether or not it is a digital file or not.

Can you please send me 20 photos of you, along with roughly 10 minutes of audio?

[-] MagicShel@programming.dev 3 points 6 months ago

So you're suggesting that saving the image is where it becomes harmful?

[-] WamGams@lemmy.ca -2 points 6 months ago

Let's start with the creation of pornography starring you. Currently I am considering having 100 German men using you as a toilet.

Please provide images of yourself and a small clip containing your voice.

[-] MagicShel@programming.dev 5 points 6 months ago

Do you, in all seriousness, think this is any kind of winning argument? I give absolutely zero fucks if someone wants to jerk off to my image in privacy. Zero. For all you know being a toilet for 100 German men is what I call a fun Tuesday evening.

I'm just trying to identify the exact thing you think does harm to a person when done in complete privacy.

[-] WamGams@lemmy.ca -2 points 6 months ago

If you give zero fucks, hand it over.

[-] MagicShel@programming.dev 3 points 6 months ago

Look if you like to jerk off to fetish porn of random strangers that's totally on you. If you do it in private, I'll never know and certainly never care whether it's me or not. If you don't then we've established that's harmful. So what is the point of this empty challenge? I've got nothing to prove to you. You can either accept my word at face value or not. I don't actually care where you draw the line between imagination and harm, but it's kinda weird that you can't accept that folks can have a reasonable difference of opinion. That's a you problem. See ya.

[-] WamGams@lemmy.ca -2 points 6 months ago

So you are obstructing me from accomplishing what you think is okay to do without consent...

Very very interesting.

[-] MagicShel@programming.dev 3 points 6 months ago* (last edited 6 months ago)

Not enabling you is obstruction? My dude do whatever you want if you can. My image is out there on Facebook and other platforms. God speed, you kinky fucker. Or, if you're not actually trying to get off, then this whole thing is in bad faith.

[-] WamGams@lemmy.ca -2 points 6 months ago

Pm me your Facebook account.

[-] iopq@lemmy.world 2 points 6 months ago

If it's a deepfake of a celeb you like, you may likely never get the real thing

[-] WamGams@lemmy.ca -1 points 6 months ago
[-] teamevil@lemmy.world 4 points 6 months ago

Don't fake kink shame....

[-] Gradually_Adjusting@lemmy.world -1 points 6 months ago

I'm not a legal expert, but it seems like creating nonconsensual sexual depictions should be illegal already?

[-] Omegamanthethird@lemmy.world 19 points 6 months ago

People make art/cartoons of people/characters for personal use all the time which often leads to NSFW. I don't know, as an American that seems like the kind of thing you should be free to do. But the harassment angle is undeniable.

[-] Gradually_Adjusting@lemmy.world 3 points 6 months ago

Making art and having it are quite inalienable rights, but transmitting it online is when things get iffy... And if you had to transmit it to make it, as with AI... I think I could talk myself into agreeing with the need to pass a law on that basis

[-] MagicShel@programming.dev 9 points 6 months ago

You can generate deepfake nudes on a modest home gaming PC. No transmission required.

[-] tsonfeir@lemm.ee -5 points 6 months ago
[-] BreakDecks@lemmy.ml 2 points 6 months ago

Not sure how you're tying opposition to monarchy with the practice of making nonconsensual pornography. Parliament is the one pushing this legislation.

I don't think the royals are going to have a better solution.

[-] tsonfeir@lemm.ee -2 points 6 months ago

What? I’m making a jab at the right-wing for not supporting laws like this.

[-] BreakDecks@lemmy.ml 1 points 6 months ago

This is a story about England and Wales, and you brought up Republicans.

I am making a joke at your expense, America Brain.

[-] tsonfeir@lemm.ee -1 points 6 months ago

I know. I’m just cracking an American joke.

Enjoy your brexit fallout.

[-] BreakDecks@lemmy.ml 1 points 6 months ago

I am also an American, I just read the article far enough to know that we're not talking about America in this thread.

[-] tsonfeir@lemm.ee -2 points 6 months ago
[-] BreakDecks@lemmy.ml 1 points 6 months ago

This is certainly news to me.

[-] tsonfeir@lemm.ee 0 points 6 months ago

Glad I could help you out.

this post was submitted on 16 Apr 2024
120 points (92.9% liked)

News

23266 readers
3827 users here now

Welcome to the News community!

Rules:

1. Be civil


Attack the argument, not the person. No racism/sexism/bigotry. Good faith argumentation only. This includes accusing another user of being a bot or paid actor. Trolling is uncivil and is grounds for removal and/or a community ban. Do not respond to rule-breaking content; report it and move on.


2. All posts should contain a source (url) that is as reliable and unbiased as possible and must only contain one link.


Obvious right or left wing sources will be removed at the mods discretion. We have an actively updated blocklist, which you can see here: https://lemmy.world/post/2246130 if you feel like any website is missing, contact the mods. Supporting links can be added in comments or posted seperately but not to the post body.


3. No bots, spam or self-promotion.


Only approved bots, which follow the guidelines for bots set by the instance, are allowed.


4. Post titles should be the same as the article used as source.


Posts which titles don’t match the source won’t be removed, but the autoMod will notify you, and if your title misrepresents the original article, the post will be deleted. If the site changed their headline, the bot might still contact you, just ignore it, we won’t delete your post.


5. Only recent news is allowed.


Posts must be news from the most recent 30 days.


6. All posts must be news articles.


No opinion pieces, Listicles, editorials or celebrity gossip is allowed. All posts will be judged on a case-by-case basis.


7. No duplicate posts.


If a source you used was already posted by someone else, the autoMod will leave a message. Please remove your post if the autoMod is correct. If the post that matches your post is very old, we refer you to rule 5.


8. Misinformation is prohibited.


Misinformation / propaganda is strictly prohibited. Any comment or post containing or linking to misinformation will be removed. If you feel that your post has been removed in error, credible sources must be provided.


9. No link shorteners.


The auto mod will contact you if a link shortener is detected, please delete your post if they are right.


10. Don't copy entire article in your post body


For copyright reasons, you are not allowed to copy an entire article into your post body. This is an instance wide rule, that is strictly enforced in this community.

founded 1 year ago
MODERATORS