The BaseResearcharXiv

Open Problems in Chatbots and Mental Health

An 11-author team from Stanford, Chicago, Carnegie Mellon and other universities sets out open problems in how general-purpose chatbots affect mental health: controlled evaluation, real-world evidence and policy. The commentary offers 12 recommendations and 12 open questions, not new experiments.

Open the source ↗3 quotations checked, word for word ↓

Why it matters

The same thing, for different readers.

What it means for you

Researchers say chatbots can help with emotional support but have also been linked to delusional spirals and crises, and that nobody yet knows how common these harms are.

For lawmakers

The authors urge lawmakers and companies to set user protections, standards of care, incident reporting and post-deployment monitoring, and to arrange protected research access to chat logs.

For researchers

The paper argues that benchmark scores do not show a chatbot is safer, and calls for validated simulations, testing of full products and long-term studies of real users.

In their own words

Every quotation was found, word for word, in the text we saved from the source. That shows the words are there; it does not make them true, or prove the speaker meant them as quoted.

From the source’s own text.

“conventional benchmarks that primarily rely on static datasets cannot establish chatbot safety, and novel simulation methods need validation.”
Jared MooreThe authors' abstract, giving an example of a tractable problem in controlled evaluation of chatbots.
Found word for word in the source
“better benchmark performance does not necessarily make a system safer or prove that it will improve well-being.”
Jared MooreOpening of the paper's section on controlled evaluation.
Found word for word in the sourcestarts inside a longer claim, right after “but”
“Despite these harms, researchers do not yet know the prevalence or causal effects of chatbot use on mental health.”
Jared MooreFrom the introduction, after noting reported delusional spirals, crises and suicide linked to chatbot use.
Found word for word in the source

The record

Questions
How is AI changing childhood, health and daily life? · Are AI companies putting stronger safeguards into practice?
People
Jared Moore (Wrote it) · Jacy Reese Anthis (Wrote it) · William Agnew (Wrote it) · Andrea Mock (Wrote it) · Kevin Klyman (Wrote it) · Sanmi Koyejo (Wrote it) · Nick Haber (Wrote it) · Stevie Chancellor (Wrote it) · Eric Lin (Wrote it) · Ryan Louie (Wrote it) · Desmond C. Ong (Wrote it)
What we read
We could read only part of the source.
Found by
The Radar, run of November 8, 2026, via arxiv-ai-safety-query (tier 1: the source’s own channel or an official record)
Cite this
arXiv, “Open Problems in Chatbots and Mental Health”, November 7, 2026. Entry in the Ctrl AI Base, https://ctrlai.com/base/arxiv-2026-11-07-open-problems-chatbots-mental-health
Our notesPosition paper; the authors say they did not use a formal literature-selection protocol. Read the abstract, introduction, related work, approach and the start of the controlled-evaluation section in full; the later sections on real-world evidence and policy were not read in detail. Author affiliations: Stanford, University of Chicago, Carnegie Mellon, Vals AI, Harvard, University of Minnesota, Vanderbilt, University of Texas at Austin.