34
cross-posted from: https://lemmy.ml/post/35349105
Aug. 26, 2025, 7:40 AM EDT
By Angela Yang, Laura Jarrett and Fallon Gallagher[this is a truly scary incident, which shows the incredible dangers of AI without guardrails.]
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 28 Aug 2025
34 points (92.5% liked)
Technology
39598 readers
300 users here now
This is the official technology community of Lemmy.ml for all news related to creation and use of technology, and to facilitate civil, meaningful discussion around it.
Ask in DM before posting product reviews or ads. All such posts otherwise are subject to removal.
Rules:
1: All Lemmy rules apply
2: Do not post low effort posts
3: NEVER post naziped*gore stuff
4: Always post article URLs or their archived version URLs as sources, NOT screenshots. Help the blind users.
5: personal rants of Big Tech CEOs like Elon Musk are unwelcome (does not include posts about their companies affecting wide range of people)
6: no advertisement posts unless verified as legitimate and non-exploitative/non-consumerist
7: crypto related posts, unless essential, are disallowed
founded 6 years ago
MODERATORS
I don't understand your logic here. Clearly, the kid had problems that were not caused by ChatGPT. And his suicidal thoughts were not started by ChatGPT. But OpenAI acknowledged that the longer the engagement continues the more likely that ChatGPT will go off the rails. Which is what happened here. At first, ChatGPT was giving the standard correct advice about suicide lines, etc. Then it started getting darker, where it was telling the kid to not let his mother know how he was feeling. Then it progressed to actual suicide coaching. So I don't think the analogy to videogames is correct here.
Take away chatgpt and insert a videogame, movie o bookthat talk about those same topics.
There are books that talk much darker about suicide. If the kid were to read those the parents would sue the author of the book?
There is a whole subgenre of music that is about encouraging people to comit suicide and fall into depression, do we use the "who is going to think about the children" card with thar music and its authors? Because music can really get under you skin and a couple of hours listening to that would nake anyone have weird thoughts.
The shitty parents blame chatgpt because it told the kid how to make a noose. You can kind that info in "howto" with instructable images. Do we put the UK nanny dictatorship controls on "howto" ? Or it only counts of it's something that benefits of the butlerian yihad?
I think is completely irrational to blame a piece of software (or media), as much defective as it is, for a suicide.