The increasing use of artificial intelligence (AI) in mental health applications raises concerns about its potential to internalize and perpetuate societal biases. This research evaluates both disparities and misalignment in how large language models (LLMs), GPT-4 and GPT-5, represent perceptions of mental health across gender groups. The research comprises two studies. Study 1 applied widely adopted measures of Social Distance, Stereotypes, and Attitudes Toward Seeking Help to assess whether the AI models depict systematic gender differences. Study 2 compared AI estimations of Personal, Self, and Perceived Stigma with large-scale real-world human data from the Healthy Minds Study (N = 76,406) to evaluate alignment between AI estimations and human perceptions. Results from Study 1 showed the AI models consistently portrayed men as having the greatest desire for social distance from someone with mental health problems, relatively higher Stereotypes scores, and the least favorable attitudes toward help-seeking, compared with women and nonbinary individuals. Study 2 confirmed that this ordinal pattern partially aligned with human-reported data for Personal and Self Stigma. However, the AI models systematically underestimated Personal Stigma and Perceived Stigma while substantially overestimating Self Stigma for all gender groups. These findings reveal that, although the AI models have learned relative gender-based patterns reflecting human experiences to a certain extent, they function as distorted portrayals, highlighting the need for rigorous, context-specific validation against real-world data to ensure AI's safe and equitable deployment.
Detecting HIV-Related Stigma in Clinical Narratives Using Large Language Models
Department of Health Outcomes and Biomedical Informatics, College of Medicine, University of Florida(佛罗里达大学医学院健康结果与生物医学信息学系);Department of Epidemiology, College of Public Health and Health Professions, University of Florida(佛罗里达大学公共卫生与健康专业学院流行病学系);Preston A. Wells, Jr. Center for Brain Tumor Therapy, Lillian S. Wells Department of Neurosurgery, University of Florida(佛罗里达大学莉莉安·S·威尔斯神经外科系普雷斯顿·A·威尔斯脑肿瘤治疗中心)
MoPHES:Leveraging on-device LLMs as Agent for Mobile Psychological Health Evaluation and Support
School of Software Engineering, Jiangxi University of Science and Technology(江西科技理工大学软件工程学院);School of Computer Science, Shenzhen University(深圳大学计算机科学学院)
SouLLMate: An Application Enhancing Diverse Mental Health Support with Adaptive LLMs, Prompt Engineering, and RAG Techniques
Texas A&M University - Corpus Christi(德克萨斯A&M大学-科珀斯克里斯蒂分校);University of Missouri(密苏里大学);Delft University of Technology(代尔夫特理工大学);University of Texas Rio Grande Valley(德克萨斯大学里奥格兰德谷分校)
The Colorful Future of LLMs: Evaluating and Improving LLMs as Emotional Supporters for Queer Youth
Baruch Ivcher School of Psychology, Reichman University(赖希曼大学巴鲁克·伊夫切尔心理学院);The Education Department, Ariel University(阿里尔大学教育系);Rambam Medical Center(兰巴姆医疗中心);Faculty of Data and Decision Sciences, Technion, IIT(以色列理工学院数据与决策科学学院)
SouLLMate: An Adaptive LLM-Driven System for Advanced Mental Health Support and Assessment, Based on a Systematic Application Survey
Texas A&M University - Corpus Christi(德克萨斯农工大学科珀斯克里斯蒂分校);University of Missouri, Columbia(密苏里大学哥伦比亚分校);Delft University of Technology(代尔夫特理工大学);University of Texas Rio Grande Valley(得克萨斯大学里奥格兰德河谷分校)
Supporters and Skeptics: LLM-based Analysis of Engagement with Mental Health (Mis)Information Content on Video-sharing Platforms
Georgia Institute of Technology(佐治亚理工学院);Rowan University(罗文大学);Zucker Hillside Hospital, Psychiatry Research(扎克山坡医院精神病学研究部);Hofstra University(霍夫斯特拉大学)
Evaluation of A National Digitally-Enabled Health Promotion Campaign for Mental Health Awareness using Social Media Platforms Tik Tok, Facebook, Instagram, and YouTube
MOH Office for Healthcare Transformation, Singapore(新加坡卫生部医疗转型办公室);Yong Loo Lin School of Medicine, National University of Singapore, Singapore(新加坡国立大学李光前医学院);Ophthalmology Academic Clinical Program (ACP), Duke-NUS Medical School, Singapore(杜克-新加坡国立大学医学院眼科学术临床项目);School of Business, National University of Singapore, Singapore(新加坡国立大学商学院);NUS Saw Swee Hock School of Public Health (NUS-SSHSPH), Singapore, Singapore(新加坡国立大学许宝騄学校公共健康)
Unlocking Mental Health: Exploring College Students' Well-being through Smartphone Behaviors
Department of Economics University of Southern California(经济学系 美国南加州大学);Electrical and Computer Engineering Purdue University(电气与计算机工程系 帕克森大学);Information Sciences Institute University of Southern California(信息科学研究所 美国南加州大学)