The increasing use of large language models in mental health applications calls for principled evaluation frameworks that assess alignment with psychotherapeutic best practices beyond surface-level fluency. While recent systems exhibit conversational competence, they lack structured mechanisms to evaluate adherence to core therapeutic principles. In this paper, we study the problem of evaluating AI-generated therapist-like responses for clinically grounded appropriateness and effectiveness. We assess each therapists utterance along six therapeutic principles: non-judgmental acceptance, warmth, respect for autonomy, active listening, reflective understanding, and situational appropriateness using a fine-grained ordinal scale. We introduce FAITH-M, a benchmark annotated with expert-assigned ordinal ratings, and propose CARE, a multi-stage evaluation framework that integrates intra-dialogue context, contrastive exemplar retrieval, and knowledge-distilled chain-of-thought reasoning. Experiments show that CARE achieves an F-1 score of 63.34 versus the strong baseline Qwen3 F-1 score of 38.56 which is a 64.26 improvement, which also serves as its backbone, indicating that gains arise from structured reasoning and contextual modeling rather than backbone capacity alone. Expert assessment and external dataset evaluations further demonstrate robustness under domain shift, while highlighting challenges in modelling implicit clinical nuance. Overall, CARE provides a clinically grounded framework for evaluating therapeutic fidelity in AI mental health systems.
Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济发展实验室);SKL-IOTSC, CIS, University of Macau(澳门科学馆物联网与智慧城市研究中心);Shandong University(山东大学);Auckland University of Technology(技术大学(奥克兰));University of Electronic Science and Technology of China(电子科技大学)
Detecting Conversational Mental Manipulation with Intent-Aware Prompting
The University of Sydney(悉尼大学);University of Technology Sydney(悉尼科技大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Harvard University(哈佛大学);University of New South Wales(新南威尔士大学)
The Art of Socratic Inquiry: A Framework for Proactive Template-Guided Therapeutic Conversation Generation
School of Information Science and Engineering, Lanzhou University(信息科学与工程学院,兰州大学);School of Medical Technology, Beijing Institute of Technology(医学技术学院,北京理工大学)
MDD-5k: A New Diagnostic Conversation Dataset for Mental Disorders Synthesized via Neuro-Symbolic LLM Agents
Theta Health Inc.(西塔健康公司);Chen Frontier Lab for AI and Mental Health, Tianqiao and Chrissy Chen Institute(天桥脑科学研究院陈天桥雒芊芊脑科学研究院AI与精神健康前沿实验室);Shanghai Mental Health Center(上海市精神卫生中心);Shanghai Jiao Tong University School of Medicine(上海交通大学医学院);Shanghai Clinical Research Center for Mental Health(上海市精神疾病临床医学中心);Shanghai Key Laboratory of Psychotic Disorders(上海市精神疾病重点实验室)
A Novel Nuanced Conversation Evaluation Framework for Large Language Models in Mental Health
School of Computer Science, Faculty of Engineering(工程学院计算机科学学院);The University of Sydney(悉尼大学);School of Computer Science and Engineering(计算机科学与工程学院);University of New South Wales(新南威尔士大学);School of Optometry and Vision Science(视光与视觉科学学院)
Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning
Florida State University(佛罗里达州立大学);University of Washington(华盛顿大学);University of Texas at Austin(德克萨斯大学奥斯汀分校)
Multi-Level Narrative Evaluation Outperforms Lexical Features for Mental Health
Institute for Artificial Intelligence(人工智能研究院);School of Psychological and Cognitive Sciences(心理学与认知科学学院);School of Intelligence Science and Technology(智能科学与技术学院);State Key Laboratory of General AI(通用人工智能国家重点实验室);Beijing Key Laboratory of Behavior and Mental Health(北京行为与心理健康重点实验室);PKU-Changsha Institute for Computing and Digital Economy(北京大学长沙计算与数字经济研究院)
K-Bench: a clinically calibrated benchmark for evaluating large language models in high-risk mental health conversations
University of Roehampton(罗汉普顿大学);Kivira Health;University of Hertfordshire(赫特福德大学);University of Surrey(萨里大学);University of Bedfordshire(贝德福德大学);Tavistock Relationships(塔维斯托克关系中心);InsideOut
SELF-PERCEPT: Introspection Improves Large Language Models' Detection of Multi-Person Mental Manipulation in Conversations
Manipal University Jaipur, India(马普尔大学斋普尔,印度);Manipal Institute of Technology, India(马普尔理工学院,印度);AryaXAI Alignment Lab, AryaXAI.com, India(AryaXAI对齐实验室,AryaXAI.com,印度);National Institute of Technology Karnataka, Surathkal, India(卡纳塔克国家理工学院,苏拉塔卡尔,印度);IISER Kolkata, India(印度科钦IISER)
Understanding the Therapeutic Relationship between Counselors and Clients in Online Text-based Counseling using LLMs
Zhejiang University(浙江大学);School of Engineering, Westlake University(西湖大学工程学院);Westlake University(西湖大学);Westlake University Research Center for Industries of the Future(西湖大学未来产业研究中心);Hangzhou Normal University(杭州师范大学)
CARE: Counselor-Aligned Response Engine for Online Mental-Health Support
Ben-Gurion University(本· Gurion 大学);School of Informatics, University of Edinburgh(爱丁堡大学信息学院);School of Informatics, University of Edinburgh Edinburgh UK(爱丁堡大学信息学院爱丁堡 英国)
Multi-Objective Alignment of Language Models for Personalized Psychotherapy
Department of Computer Science, University of California, Los Angeles, CA, USA(计算机科学系,加州大学洛杉矶分校);Department of Psychology, The University of Texas at Austin, Austin, TX, USA(心理学系,德克萨斯大学奥斯汀分校);Department of Psychiatry, NYU Grossman School of Medicine, New York, NY, USA(精神病学系,纽约大学格罗斯曼医学院)
PsychePass: Calibrating LLM Therapeutic Competence via Trajectory-Anchored Tournaments
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Lingxin AI(灵心AI);South China Normal University(华南师范大学);CoAI Group, DCST, IAI, BNRIST, Tsinghua University(清华人工智能研究院)
Auditing Framing-Sensitive Behavioral Instability in Large Language Models for Mental Health Interactions
a School of computer science, digital engineering and AI, Long Island University, Brooklyn, NY, USA(a 计算科学与数字工程及人工智能学院,罗格斯大学,布鲁克林,纽约,美国);b Department of Psychology, Long Island University, Brooklyn, NY, USA(b 心理学系,罗格斯大学,布鲁克林,纽约,美国)