预训练语言模型(Pre-trained Language Models, PLMs)有望通过提供可及且具备文化敏感性的资源,变革精神卫生支持服务。但尽管具备这一潜力,其在精神卫生保健领域、尤其是针对阿拉伯语的有效性尚未得到广泛探索。为填补这一空白,本研究评估了基础模型在精神卫生保健领域问答(Questions and Answers, Q&A)分类任务中的有效性。我们使用了MentalQA数据集,这是一个包含精神卫生相关问答交互内容的阿拉伯语数据集。本研究采用四种不同的学习方法开展实验:传统特征提取法、作为特征提取器的PLMs、PLMs微调,以及在零样本和少样本学习设置下对大语言模型(GPT-3.5和GPT-4)进行提示工程。传统特征提取器结合支持向量机(Support Vector Machines, SVM)已展现出可观性能,但PLMs凭借捕捉语义的能力取得了更优结果。例如,MARBERT取得了最高性能,问题分类的杰卡德系数(Jaccard Score)为0.80,答案分类的杰卡德系数为0.86。我们进一步开展了深度分析,包括对比微调与非微调的效果、探究数据规模变化的影响,以及进行错误分析。分析表明,微调对提升PLMs性能具有积极作用,训练数据规模对实现高性能至关重要。我们还探索了提示工程方法,其中GPT-3.5的少样本学习取得了可观结果,问题分类性能提升12%,答案分类性能提升45%。基于研究结果可以得出结论:PLMs和基于提示的方法在阿拉伯语精神卫生支持领域具有应用前景。
英文摘要:
Pre-trained Language Models (PLMs) have the potential to transform mental health support by providing accessible and culturally sensitive resources. However, despite this potential, their effectiveness in mental health care and specifically for the Arabic language has not been extensively explored. To bridge this gap, this study evaluates the effectiveness of foundational models for classification of Questions and Answers (Q&A) in the domain of mental health care. We leverage the MentalQA dataset, an Arabic collection featuring Q&A interactions related to mental health. In this study, we conducted experiments using four different types of learning approaches: traditional feature extraction, PLMs as feature extractors, Fine-tuning PLMs and prompting large language models (GPT-3.5 and GPT-4) in zero-shot and few-shot learning settings. While traditional feature extractors combined with Support Vector Machines (SVM) showed promising performance, PLMs exhibited even better results due to their ability to capture semantic meaning. For example, MARBERT achieved the highest performance with a Jaccard Score of 0.80 for question classification and a Jaccard Score of 0.86 for answer classification. We further conducted an in-depth analysis including examining the effects of fine-tuning versus non-fine-tuning, the impact of varying data size, and conducting error analysis. Our analysis demonstrates that fine-tuning proved to be beneficial for enhancing the performance of PLMs, and the size of the training data played a crucial role in achieving high performance. We also explored prompting, where few-shot learning with GPT-3.5 yielded promising results. There was an improvement of 12% for question and classification and 45% for answer classification. Based on our findings, it can be concluded that PLMs and prompt-based approaches hold promise for mental health support in Arabic.
ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data
California Institute of Technology(加州理工学院);UCLA(加州大学洛杉矶分校);National University of Singapore(新加坡国立大学);Hangzhou Dianzi University(杭州电子科技大学);Fudan University(复旦大学)
Applying and Evaluating Large Language Models in Mental Health Care: A Scoping Review of Human-Assessed Generative Tasks
Harvard T.H. Chan School of Public Health(哈佛大学陈曾熙公共卫生学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心);University of Technology Sydney(悉尼科技大学);UTHealth Houston(德克萨斯大学休斯顿健康科学中心);University of Oxford(牛津大学);Massachusetts Institute of Technology(麻省理工学院);Harvard Medical School(哈佛医学院)
Mapping Caregiver Needs to AI Chatbot Design: Strengths and Gaps in Mental Health Support for Alzheimer's and Dementia Caregivers
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Indiana University Indianapolis(印第安纳大学印第安纳波利斯分校);University of Massachusetts Amherst(马萨诸塞大学阿姆赫斯特分校)
CARE: Counselor-Aligned Response Engine for Online Mental-Health Support
Ben-Gurion University(本· Gurion 大学);School of Informatics, University of Edinburgh(爱丁堡大学信息学院);School of Informatics, University of Edinburgh Edinburgh UK(爱丁堡大学信息学院爱丁堡 英国)
A Scoping Review of AI-Driven Digital Interventions in Mental Health Care: Mapping Applications Across Screening, Support, Monitoring, Prevention, and Clinical Education
School of International and Public Affairs(国际与公共事务学院);Columbia University(哥伦比亚大学);Department of Psychology(心理学系);Seton Hall University(塞顿·霍尔大学)
Bespoke Large Language Models for Digital Triage Assistance in Mental Health Care
University of Oxford(牛津大学);Oxford Precision Psychiatry Lab(牛津精准精神病学实验室);NIHR Oxford Health Biomedical Research Centre(NIHR牛津健康生物医学研究中心);Oxford Health NHS Foundation Trust(牛津健康NHS基金会信托);University of Liverpool(利物浦大学);Civic Health Innovation Labs(城市健康创新实验室);Mental health Research for Innovation Centre (M-RIC)(心理健康创新研究中心);Mersey Care NHS Foundation Trust(默西护理NHS基金会信托)
Large Language Model-Powered Conversational Agent Delivering Problem-Solving Therapy (PST) for Family Caregivers: Enhancing Empathy and Therapeutic Alliance Using In-Context Learning
Florida State University(佛罗里达州立大学);University of Washington(华盛顿大学);University of Texas at Austin(德克萨斯大学奥斯汀分校)
Leveraging LLMs for Translating and Classifying Mental Health Data
Department of Computer Science and Engineering, University of Ioannina(计算机科学与工程系,希腊伊奥亚纳大学);LT3, IDLab, Universiteit Gent(LT3,IDLab,比利时根特大学);Department of Informatics, Athens University of Economics and Business(信息系,希腊经济与商业大学);Archimedes/AthenaRC, Greece(阿基米德/阿提卡RC,希腊)
Detecting Conversational Mental Manipulation with Intent-Aware Prompting
The University of Sydney(悉尼大学);University of Technology Sydney(悉尼科技大学);Xi’an Jiaotong-Liverpool University(西交利物浦大学);Harvard University(哈佛大学);University of New South Wales(新南威尔士大学)
Can AI Relate: Testing Large Language Model Response for Mental Health Support
New York University(纽约大学);Grossman School of Medicine(格罗斯曼医学院);Massachusetts Institute of Technology(麻省理工学院);University of California, Los Angeles(加州大学洛杉矶分校)
SouLLMate: An Application Enhancing Diverse Mental Health Support with Adaptive LLMs, Prompt Engineering, and RAG Techniques
Texas A&M University - Corpus Christi(德克萨斯A&M大学-科珀斯克里斯蒂分校);University of Missouri(密苏里大学);Delft University of Technology(代尔夫特理工大学);University of Texas Rio Grande Valley(德克萨斯大学里奥格兰德谷分校)
Towards Interpretable Mental Health Analysis with Large Language Models
The University of Manchester(曼彻斯特大学);University of Helsinki(赫尔辛基大学);Yale University(耶鲁大学);Artificial Intelligence Research Center, AIST(日本国立研究开发法人产业技术综合研究所人工智能研究中心);Jiangxi Normal University(江西师范大学)
A Conditional Companion: Lived Experiences of People with Mental Health Disorders Using LLMs
Center for Advanced Internet Studies Bochum Germany;Center for Advanced Internet Studies \& University of Wuppertal Bochum Germany;Center for Advanced Internet Studies;Center for Advanced Internet Studies \& University of Wuppertal
Helen Wills Neuroscience Institute, University of California Berkeley, USA(加州大学伯克利分校海伦·威尔斯神经科学研究所);Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London, UK(马克斯·普朗克伦敦大学学院计算精神病学与衰老研究中心);Department of Psychology, University of California Berkeley, USA(加州大学伯克利分校心理学系);Vision Science Group, University of California Berkeley, USA(加州大学伯克利分校视觉科学组)
MoPHES:Leveraging on-device LLMs as Agent for Mobile Psychological Health Evaluation and Support
School of Software Engineering, Jiangxi University of Science and Technology(江西科技理工大学软件工程学院);School of Computer Science, Shenzhen University(深圳大学计算机科学学院)
Building Trust in Mental Health Chatbots: Safety Metrics and LLM-Based Evaluation Tools
Sue & Bill Gross School of Nursing, University of California, Irvine(加州大学欧文分校苏与比尔·格罗斯护理学院);Department of Computer Sciences, University of California, Irvine(加州大学欧文分校计算机科学系);School of Medicine, University of California, Irvine(加州大学欧文分校医学院);Department of Psychological Science, University of California, Irvine(加州大学欧文分校心理科学系);Chicago School of Professional Psychology(芝加哥专业心理学院);HealthUnity
Lived Experience in Dialogue: Co-designing Personalization in Large Language Models to Support Youth Mental Well-being
Delft University of Technology(代尔夫特理工大学);University of Oulu(奥卢大学);University of Oxford(牛津大学);Hamad Bin Khalifa University(哈马德·本·哈利法大学);University of Twente(特文特大学);Erasmus University Rotterdam(鹿特丹伊拉斯姆斯大学);Stanford University(斯坦福大学)
Can Artificial Intelligence Support Healthcare and Mental Health Through Early Cyberbullying Detection ? The Impact of Emotion-Aware AI on Proactive Online Safety
Faculty of Computer Science, University of New Brunswick(新不伦瑞克大学计算机科学学院);Khoury College of Computer Sciences, Northeastern University(东北大学库里计算机科学学院)