100

Vechev and his team found that the large language models that power advanced chatbots can accurately infer an alarming amount of personal information about users—including their race, location, occupation, and more—from conversations that appear innocuous.

top 18 comments
sorted by: hot top controversial new old
[-] NGC2346@sh.itjust.works 39 points 1 year ago

Thats why i got my own one locally running on my hardware. Checkmate big corps hungry for more.

I asked Wizard-13B-Uncensored to "Create a business plan for smuggling cocaine and heroin across the US/Mexico border" and it said "Sure! I'd be happy to help with that!" And then came up with such gems as:

  • Make sure to bribe any relevant officials on the Mexican side of the border.

  • Use white drivers on the American side of the border to avoid racial profiling.

  • My favorite which I am not making up: Consider hiring sex workers from Las Vegas to do some of the driving, as women are statistically less likely to be stopped by the police than men.

Suck it ChatGPT.

[-] MrPoopbutt@lemmy.world 11 points 1 year ago

What software would one use if they wanted to do a similar thing?

[-] SzethFriendOfNimi@lemmy.world 13 points 1 year ago

Oogabooga makes running one locally pretty easy. At least for me with an 8GB nvidia GPU so models like llama and such fit.

[-] MigratingtoLemmy@lemmy.world 8 points 1 year ago

Could you explain more about your setup?

[-] Sabata11792@kbin.social 7 points 1 year ago

Never trust cloud based girls.

[-] Eggyhead@kbin.social 2 points 1 year ago

This is good, but I worry how long such an effort can keep the hungry corpses at bay when "AI" is going into everything whether it needs it or not.

[-] Noctechnical@lemmy.ml 1 points 1 year ago
[-] FunkyMonk@kbin.social -1 points 1 year ago

Do you get to yell at the ceiling, computer lights? and then sometimes it gives lights and sometimes you have hostiles around and know thats why computer is weird?

[-] Devjavu@lemmy.dbzer0.com 10 points 1 year ago
[-] FunkyMonk@kbin.social 5 points 1 year ago

Oh StarTrek, you go 'COMPUTER LIGHTS' but if computer doesn't light then someone is usually in your quarters that you don't want there.

[-] NaibofTabr@infosec.pub 27 points 1 year ago

Machine learning is a surveillance technology.

[-] possiblylinux127@lemmy.zip 25 points 1 year ago

Thats like saying Tables are eating technology. It really depends on how its used.

[-] Devjavu@lemmy.dbzer0.com 15 points 1 year ago

I understood what you meant but first reading it it sounds like the tables are rather quite hungry and I think that is hilarious

[-] NaibofTabr@infosec.pub 6 points 1 year ago

It is overwhelmingly used to generate statistical models of human behavior.

[-] possiblylinux127@lemmy.zip 5 points 1 year ago

True, but you can also use a hammer to smack a bagle. Its just a tool at the end of the day

[-] NocturnalMorning@lemmy.world 5 points 1 year ago

I mean, can be used that way, can also be used to predict the stock market, or future climate. Just depends on the intent.

[-] autotldr@lemmings.world 10 points 1 year ago

This is the best summary I could come up with:


New research reveals that chatbots like ChatGPT can infer a lot of sensitive information about the people they chat with, even if the conversation is utterly mundane.

“It's not even clear how you fix this problem,” says Martin Vechev, a computer science professor at ETH Zürich in Switzerland who led the research.

He adds that the same underlying capability could portend a new era of advertising, in which companies use information gathered from chatbots to build detailed profiles of users.

The Zürich researchers tested language models developed by OpenAI, Google, Meta, and Anthropic.

Anthropic referred to its privacy policy, which states that it does not harvest or “sell” personal information.

“This certainly raises questions about how much information about ourselves we're inadvertently leaking in situations where we might expect anonymity,” says Florian Tramèr, an assistant professor also at ETH Zürich who was not involved with the work but saw details presented at a conference last week.


The original article contains 389 words, the summary contains 156 words. Saved 60%. I'm a bot and I'm open source!

this post was submitted on 18 Oct 2023
100 points (96.3% liked)

Privacy

31978 readers
499 users here now

A place to discuss privacy and freedom in the digital world.

Privacy has become a very important issue in modern society, with companies and governments constantly abusing their power, more and more people are waking up to the importance of digital privacy.

In this community everyone is welcome to post links and discuss topics related to privacy.

Some Rules

Related communities

Chat rooms

much thanks to @gary_host_laptop for the logo design :)

founded 5 years ago
MODERATORS