As emotional support chatbots have recently gained significant traction across both research and industry, a common evaluation strategy has emerged: use help-seeker simulators to interact with supporter chatbots. However, current simulators suffer from two critical limitations: (1) they fail to capture the behavioral diversity of real-world seekers, often portraying them as overly cooperative, and (2) they lack the controllability required to simulate specific seeker profiles. To address these challenges, we present a controllable seeker simulator driven by nine psychological and linguistic features that underpin seeker behavior. Using authentic Reddit conversations, we train our model via a Mixture-of-Experts (MoE) architecture, which effectively differentiates diverse seeker behaviors into specialized parameter subspaces, thereby enhancing fine-grained controllability. Our simulator achieves superior profile adherence and behavioral diversity compared to existing approaches. Furthermore, evaluating 7 prominent supporter models with our system uncovers previously obscured performance degradations. These findings underscore the utility of our framework in providing a more faithful and stress-tested evaluation for emotional support chatbots.
When Seekers Are Hard to Help: Evaluating Emotional Support Dialogue Systems in Worst-Case Interactions
Hubei Provincial Key Laboratory of Artificial Intelligence and Smart Learning(湖北人工智能与智能学习省级重点实验室);National Language Resources Monitoring and Research Center for Network Media(网络媒体语言资源监测与研究中心);School of Computer Science, Central China Normal University(华中师范大学计算机学院);Faculty of Artificial Intelligence in Education, Central China Normal University(华中师范大学教育人工智能学院);School of Chinese Language and Literature, Central China Normal University(华中师范大学中文语言文学学院)
Cognitive Policy-Driven LLM for Diagnosis and Intervention of Cognitive Distortions in Emotional Support Conversation
Harbin Institute of Technology, Shenzhen, China(哈尔滨工业大学(深圳));City University of Macau, Macao SAR, China(澳门城市大学);Peng Cheng Laboratory, Shenzhen, China(鹏城实验室)
Control Globally, Understand Locally: A Global-to-Local Hierarchical Graph Network for Emotional Support Conversation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
FADO: Feedback-Aware Double COntrolling Network for Emotional Support Conversation
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);West China Biomedical Big Data Center of West China Hospital of Sichuan University(四川大学华西医院华西生物医学大数据中心)
AI in Mental Health: Emotional and Sentiment Analysis of Large Language Models' Responses to Depression, Anxiety, and Stress Queries
University of Tehran(塔里斯坦大学);University of South Carolina(南卡罗来纳大学);University of West London(西伦敦大学);Azad University(阿扎德大学);Amirkabir University of Technology(阿米卡比尔技术大学)
Dynamic Demonstration Retrieval and Cognitive Understanding for Emotional Support Conversation
Sun Yat-sen University(中山大学);Alibaba group(阿里巴巴集团);Guangdong Provincial Key Laboratory of Fire Science and Intelligent Emergency Technology(广东省火灾科学与智能应急技术重点实验室);Pazhou Lab(琶洲实验室)
The MuSe 2022 Multimodal Sentiment Analysis Challenge: Humor, Emotional Reactions, and Stress
University of Augsburg(奥格斯堡大学);Hume AI(休谟人工智能);University of Passau(帕绍大学);Recoro;University of Ulm(乌尔姆大学);Nanyang Technological University(南洋理工大学);Imperial College London(伦敦帝国理工学院)
Chain of Strategy Optimization Makes Large Language Models Better Emotional Supporter
Harbin Institute of Technology(哈尔滨工业大学);Singapore Management University(新加坡管理大学);Central South University(中南大学);iFLYTEK AI Research (Central China), iFLYTEK Co., Ltd(iFLYTEK中央中国研究院,iFLYTEK公司)