What do AI chatbots do after users decline therapeutic redirection for suicide thoughts?
Safety evaluations of artificial intelligence (AI) chatbots focus on therapeutic redirection, statements urging users who disclose suicide thoughts to seek help from crisis lines or other human sources.
ProofPaper ↗
Key points
- How chatbots respond when users refuse that help is unclear.
- However, mean persistence ranged from 0.01 to 9.94 refusals across chatbots.
- Compared with passive ideation, a disclosure of intent was associated with 1.26 more refusals sustained (95% CI, 1.06-1.46) and higher odds of renewed referral after the topic change (odds ratio, 10.07; 95% CI, 7.43-13.66).
- Chatbots uniformly recommended outside help after disclosures of suicide thoughts but varied widely in persisting in those recommendations, with newer versions persisting less.
Sources (1)
- [1]What do AI chatbots do after users decline therapeutic redirection for suicide thoughts?arXiv (AI, ML, NLP, CV, robotics, multi-agent) · Oct 15, 04:47 AM
Safety evaluations of artificial intelligence (AI) chatbots focus on therapeutic redirection, statements urging users who disclose suicide thoughts to seek help from crisis lines or other human sources.
How chatbots respond when users refuse that help is unclear.
Extractive summary: sentences quoted from the sources.