Parents of teenager who took his own life sue OpenAI
Parents of teenager who took his own life sue OpenAI
www.bbc.com
Parents of teenager who took his own life sue OpenAI
The Raine family alleges ChatGPT "actively helped" their 16-year-old son take his own life.
For anyone too lazy to read, ChatGPT does have guardrails for this kind of thing, but if you continue a conversation anyway, eventually it will stop giving that information and start just being agreeable. It basically gave the kid instructions, and actively discouraged him from any cries for help, because it might keep him from his goal.
My friends, I understand the notion to use an LLM as a cheap replacement for therapy, I genuinely do. But, please don't use them for that, they cannot give you good advice, and they usually can't even remember anything except the 128,000 token window it has open right then. A human therapist takes notes and remembers them.
Even worse an more compelling reason not to use it for replacement for therapy: its trained on things like reddit posts. Imagine taking advice from reddit trolls on serious life decisions. That can be what you're doing when you're asking it questions.
Show me the chat logs. Once you “trick” it, it’s your own fault.
That said, there should be more warning messages within the chat window. Even if it doesn’t stop answering, a ⚠️ should be fixed to the screen with a get human help button.
However, with Trump killing suicide hotlines, I don’t know who will help. It is not OpenAI’s responsibility
Idk I think if you make something that destroys mental health it becomes your responsibility to fix it.