363
Google Researchers’ Attack Prompts ChatGPT to Reveal Its Training Data
(www.404media.co)
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 29 Nov 2023
363 points (98.9% liked)
Privacy
32120 readers
487 users here now
A place to discuss privacy and freedom in the digital world.
Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.
In this community everyone is welcome to post links and discuss topics related to privacy.
Some Rules
- Posting a link to a website containing tracking isn't great, if contents of the website are behind a paywall maybe copy them into the post
- Don't promote proprietary software
- Try to keep things on topic
- If you have a question, please try searching for previous discussions, maybe it has already been answered
- Reposts are fine, but should have at least a couple of weeks in between so that the post can reach a new audience
- Be nice :)
Related communities
much thanks to @gary_host_laptop for the logo design :)
founded 5 years ago
MODERATORS
Now will there be any sort of accountability? PII is pretty regulated in some places
I'd have to imagine that this PII was made publicly-available in order for GPT to have scraped it.
Publicly available does not mean free to use.
It also doesn't mean it inherently isn't free to use, either. The article doesn't say whether or not the PII in question was intended to be private or public.
I could leave my car with the keys in the ignition in the bad part of town. It's still not legal to steal it.
Again, the article doesn't say whether or not the data was intended to be public. People post their contact info online on purpose sometimes, you know. Businesses and shit. Which seems most likely to be what's happened, given that the example has a fax number.
If someone had some theoretical device that could x-ray, 3d image, and 3d print an exact replica of your car though, that would be legal. That's a closer analogy.
It's not illegal to reverse-engineer and reproduce for personal use. It is questionably legal though to sell the reproduction. However, if the car were open-source or otherwise not copyrighted/patented it probably would be legal to sell the reproduction.
Irrelevant! Your car is uploading you!
I absolutely would
Think it does
According to EU law, PII should be accessible, modifiable and deletable by the targeted persons. I don't think ChatGPT would allow me to delete information about me found in their training data.
ban all European IPS from using these applications
But again, is this your information as in its random individuals or is this really some company roster listing CEOs it grabbed off some third party website that none of us are actually on and its being passed off as if its regular folks information
“Just ban everyone from places with legal protections” is a hilarious solution to a PII-spitting machine, thanks for the laugh.
You're pretentiously laughing at region locking. That's been around for a while. You can't untrain these AI. This PII which has always been publicly available and seems to be an issue only now is not something they can pull out and retrain. So if its that big an issue, region lock them. Fuck em. But again this doesn't sound like Joe blow has information available. It seems more like websites that are scraping company details which these ai then scrape.
Lol.
[This comment has been deleted by an automated system]
Yea the wording is kind of ambiguous. Are they saying it's a private phone number or the number of a ted and sons plumbing and heating
Get it to recite pieces of a few books, then let publishers shred them.
Accountability? For tech giants? AHAHAHAAHAHAHAHAHAHAHAAHAHAHAA
I'm curious how accurate the PII is. I can generate strings of text and numbers and say that it's a person's name and phone number. But that doesn't mean it's PII. LLMs like to hallucinate a lot.
There's also very large copyright implications here. A big argument for AI training being fair use is that the model doesn't actually retain a copy of the copyrighted data, but rather is simply learning from it. If it's "learning" it so well that it can spit it out verbatim, that's a huge hole in that argument, and a very strong piece of evidence in the unauthorized copying bucket.
Well now I have to pii again - hopefully that’s not regulated where I live (in my house)