How to evaluate mental and behavioral health AI
Mental health AI includes chat tools that talk with patients, software that tracks symptom scores, and tools that write session notes. The risks are very different: a note-writing tool never speaks to a patient in crisis, but a chat tool might.
Use the section that matches the tool. The questions in the core guide apply to all of them.
Last reviewed November 2026 · Independent and vendor-neutral
What does the tool you’re evaluating do?
Jump to the matching checklist. Some answers lead to a different guide.
Tools that talk with patients
Applies if the tool chats, messages or speaks with patients, for example for support between sessions, intake or self-guided programs.
Questions to ask
- How does it detect suicidality and other crises, and what exactly happens next? Who is alerted, and how fast, at night and on weekends?
- Is it presented as therapy, or as support alongside a clinician? Several states restrict AI therapy. Illinois, for example, has barred AI from making independent therapeutic decisions or communicating therapeutically with clients since August 2025.
- Does it have FDA authorization for any clinical claim it makes? An FDA advisory committee noted in November 2025 that no generative-AI device had yet been authorized for mental health uses.
- How are minors, and people who say they are minors, handled?
Red flags
- "AI therapist" positioning
- No tested crisis protocol
- Wellness labelling combined with clinical claims
Symptom measurement and risk flags
Applies if the tool collects or analyzes symptom scores (such as PHQ-9 or GAD-7), or predicts risk from records, speech or other signals.
Questions to ask
- For predictions: how many people are flagged, how many flags are true positives, and what action does each flag require?
- How does it perform across age, race, language and diagnosis?
- Who reviews flags, and how are missed warnings handled?
Red flags
- Risk scores with no attached action
- No breakdown of performance by group
The predictive-tools guide covers alert thresholds, calibration and silent testing in more detail. Read that guide →
Session notes and documentation
Applies if the tool records or transcribes sessions and drafts notes.
Questions to ask
- Does it keep recordings or transcripts? Therapy content is highly sensitive; ask how long data is kept and whether it is used to train products.
- For substance-use treatment records, does it support 42 CFR Part 2 requirements?
- How does it handle group sessions, family sessions and interpreters?
- How do clients consent to recording, and can they decline without affecting care?
The clinical documentation guide covers scribe accuracy, editing time and consent in more detail. Read that guide →
Further reading
Browse mental health tools
Every listing shows regulatory status, published evidence and named health-system users where public.