ChatGPT adds mental health guardrails after bot ‘fell short in recognizing signs of delusion’ 😧
OpenAI wants ChatGPT to stop enabling its users’ unhealthy behaviors.
Starting Monday, the popular chatbot app will prompt users to take breaks from lengthy conversations. The tool will also soon shy away from giving direct advice about personal challenges, instead aiming to help users decide for themselves by asking questions or weighing pros and cons.
“There have been instances where our 4o model fell short in recognizing signs of delusion or emotional dependency,” OpenAI wrote in an announcement. “While rare, we’re continuing to improve our models and are developing tools to better detect signs of mental or emotional distress so ChatGPT can respond appropriately and point people to evidence-based resources when needed.”
https://www.nbcnews.com/tech/tech-news/chatgpt-adds-mental-health-guardrails-openai-announces-rcna222999
Interesting stuff there, enough to write a couple pages on it with examples culled from here. 😉
Looks like they did steal my idea about the need for evidence, although ChatGPT will provide it.