CIFoundry

How to evaluate mental and behavioral health AI

Mental health AI includes chat tools that talk with patients, software that tracks symptom scores, and tools that write session notes. The risks are very different: a note-writing tool never speaks to a patient in crisis, but a chat tool might.

Use the section that matches the tool. The questions in the core guide apply to all of them.

Last reviewed November 2026 · Independent and vendor-neutral

What does the tool you’re evaluating do?

Jump to the matching checklist. Some answers lead to a different guide.

Tools that talk with patients

Applies if the tool chats, messages or speaks with patients, for example for support between sessions, intake or self-guided programs.

Questions to ask

  • How does it detect suicidality and other crises, and what exactly happens next? Who is alerted, and how fast, at night and on weekends?
  • Is it presented as therapy, or as support alongside a clinician? Several states restrict AI therapy. Illinois, for example, has barred AI from making independent therapeutic decisions or communicating therapeutically with clients since August 2025.
  • Does it have FDA authorization for any clinical claim it makes? An FDA advisory committee noted in November 2025 that no generative-AI device had yet been authorized for mental health uses.
  • How are minors, and people who say they are minors, handled?

Red flags

  • "AI therapist" positioning
  • No tested crisis protocol
  • Wellness labelling combined with clinical claims

Symptom measurement and risk flags

Applies if the tool collects or analyzes symptom scores (such as PHQ-9 or GAD-7), or predicts risk from records, speech or other signals.

Questions to ask

  • For predictions: how many people are flagged, how many flags are true positives, and what action does each flag require?
  • How does it perform across age, race, language and diagnosis?
  • Who reviews flags, and how are missed warnings handled?

Red flags

  • Risk scores with no attached action
  • No breakdown of performance by group

The predictive-tools guide covers alert thresholds, calibration and silent testing in more detail. Read that guide →

Session notes and documentation

Applies if the tool records or transcribes sessions and drafts notes.

Questions to ask

  • Does it keep recordings or transcripts? Therapy content is highly sensitive; ask how long data is kept and whether it is used to train products.
  • For substance-use treatment records, does it support 42 CFR Part 2 requirements?
  • How does it handle group sessions, family sessions and interpreters?
  • How do clients consent to recording, and can they decline without affecting care?

The clinical documentation guide covers scribe accuracy, editing time and consent in more detail. Read that guide →

Whatever the tool does, the 12 core questions (evidence, data rights, liability, monitoring, contracts) also apply.

Further reading

Browse mental health tools

Every listing shows regulatory status, published evidence and named health-system users where public.

Other evaluation guides

Last reviewed November 2026. Educational information, not medical, legal or regulatory advice.

No vendor reviewed, sponsored or edited this guide. Listing is free; no one can pay to change the order.