arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.00129cs.CLcs.AI
收藏

一种以数据为中心的方法用于检测和缓解儿科心理健康文本中的人口统计学偏差:以焦虑检测为例

A Data-Centric Approach to Detecting and Mitigating Demographic Bias in Pediatric Mental Health Text: A Case Study in Anxiety Detection

University College London(伦敦大学学院);Queen Mary University of London(伦敦玛丽女王大学);University of Cincinnati(辛辛那提大学);Oak Ridge National Laboratory(橡树岭国家实验室)
Julia Ive, Paulina Bondaronek, Vishal Yadav, Daniel Santel, Tracy Glauser, Tina Cheng, Jeffrey R. Strawn, Greeshma Agasthya, Jordan Tschida, Sanghyun Choo, Maya… 展开作者

Julia Ive, Paulina Bondaronek, Vishal Yadav, Daniel Santel, Tracy Glauser, Tina Cheng, Jeffrey R. Strawn, Greeshma Agasthya, Jordan Tschida, Sanghyun Choo, Mayanka Chandrashekar, Anuj J. Kapadia, John Pestian

AI总结:

本文提出一种以数据为中心的去偏方法,通过中和性别化语言并保留临床关键信息,缓解儿科心理健康文本中的人口统计学偏差,在焦虑检测中将诊断偏差降低最多27%。

摘要:

引言:医疗人工智能模型常常继承其训练数据中的偏差。虽然已有工作主要针对结构化数据中的偏差,但心理健康在很大程度上依赖于非结构化数据。本研究旨在检测和缓解用于辅助儿科心理健康筛查的人工智能模型训练数据中与非生物学差异相关的语言差异。我们的目标是:(1)通过评估不同性别亚组之间的结果公平性来评估偏差的存在,(2)通过文本分布分析识别偏差来源,(3)开发一种针对心理健康文本数据的去偏方法。方法:我们考察了不同人口统计学组之间的分类公平性,并评估了性别化语言如何影响模型预测。我们应用了一种以数据为中心的去偏方法,重点是在保留显著临床信息的同时中和有偏术语。该方法在一个用于儿科患者自动焦虑检测的模型上进行了测试。结果:我们的研究结果揭示了女性青少年患者被系统性漏诊的现象,与男性患者相比,其准确率低4%,假阴性率(FNR)高9%,这可能是由于患者记录中信息密度和语言差异造成的。男性患者的记录平均长500个单词,语言相似性指标表明不同性别之间的词汇分布存在明显差异。实施我们的去偏方法后,诊断偏差降低了最多27%,证明了该方法在提升不同人口统计学组之间公平性方面的有效性。讨论:我们开发了一个以数据为中心的去偏框架,以解决临床文本中基于性别的内容差异。通过中和有偏语言并增强对临床关键信息的关注,我们的方法展示了一种有效的策略,可用于缓解在文本上训练的医疗人工智能模型中的偏差。

英文摘要:

Introduction: Healthcare AI models often inherit biases from their training data. While efforts have primarily targeted bias in structured data, mental health heavily depends on unstructured data. This study aims to detect and mitigate linguistic differences related to non-biological differences in the training data of AI models designed to assist in pediatric mental health screening. Our objectives are: (1) to assess the presence of bias by evaluating outcome parity across sex subgroups, (2) to identify bias sources through textual distribution analysis, and (3) to develop a de-biasing method for mental health text data. Methods: We examined classification parity across demographic groups and assessed how gendered language influences model predictions. A data-centric de-biasing method was applied, focusing on neutralizing biased terms while retaining salient clinical information. This methodology was tested on a model for automatic anxiety detection in pediatric patients. Results: Our findings revealed a systematic under-diagnosis of female adolescent patients, with a 4% lower accuracy and a 9% higher False Negative Rate (FNR) compared to male patients, likely due to disparities in information density and linguistic differences in patient notes. Notes for male patients were on average 500 words longer, and linguistic similarity metrics indicated distinct word distributions between genders. Implementing our de-biasing approach reduced diagnostic bias by up to 27%, demonstrating its effectiveness in enhancing equity across demographic groups. Discussion: We developed a data-centric de-biasing framework to address gender-based content disparities within clinical text. By neutralizing biased language and enhancing focus on clinically essential information, our approach demonstrates an effective strategy for mitigating bias in AI healthcare models trained on text.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑