265
submitted 1 year ago* (last edited 1 year ago) by ekZepp@lemmy.world to c/technology@lemmy.ml

The tool, called Nightshade, messes up training data in ways that could cause serious damage to image-generating AI models. Is intended as a way to fight back against AI companies that use artists’ work to train their models without the creator’s permission.

ARTICLE - Technology Review

ARTICLE - Mashable

ARTICLE - Gizmodo

The researchers tested the attack on Stable Diffusion’s latest models and on an AI model they trained themselves from scratch. When they fed Stable Diffusion just 50 poisoned images of dogs and then prompted it to create images of dogs itself, the output started looking weird—creatures with too many limbs and cartoonish faces. With 300 poisoned samples, an attacker can manipulate Stable Diffusion to generate images of dogs to look like cats.

you are viewing a single comment's thread
view the rest of the comments
[-] ekZepp@lemmy.world 5 points 1 year ago
[-] WhatAmLemmy@lemmy.world 16 points 1 year ago

The problem is that the chart is shit. There's a prompt on the top and then text on the bottom that looks identical to the prompt, but is actually just what the top prompt was poisoned to look like after 100 or 300 samples.

If users have to read a paragraph of text to understand a chart, the chart is shit.

[-] bruce965@lemmy.ml 18 points 1 year ago

A less salty way to put it would be that the chart is missing two labels: "Original prompt" and "Poisoned prompt".

[-] WhatAmLemmy@lemmy.world 4 points 1 year ago

The second isn't even a prompt. I can't fault you for getting it wrong though, because the chart is so shit!

[-] ekZepp@lemmy.world 8 points 1 year ago

Not very clear indeed. Each column is a determinate image who is been poisoned and as the lvl of poisoning increase the generated images degrade and turn in something completely different.

[-] SaltyIceteaMaker@lemmy.ml -2 points 1 year ago

Im just gonna be direct. If you cannot understand that chart you severely lack understanding of context.

If you just look at 3 pictures in one row and read the text you should easily be able to understand what the chart is about... That's like 10 year old logical thinking, if not even younger.

this post was submitted on 24 Oct 2023
265 points (91.8% liked)

Technology

34899 readers
855 users here now

This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.


Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.


Rules:

1: All Lemmy rules apply

2: Do not post low effort posts

3: NEVER post naziped*gore stuff

4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.

5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)

6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist

7: crypto related posts, unless essential, are disallowed

founded 5 years ago
MODERATORS