arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.00199cs.CLcs.AI
收藏

GPT-4在临床抑郁症评估中的应用:一项基于大语言模型的初步研究

GPT-4 on Clinic Depression Assessment: An LLM-Based Pilot Study

University of Waterloo(滑铁卢大学);Centre for Digital Therapeutics(数字治疗中心)

Giuliano Lorenzoni, Pedro Elkind Velmovitsky, Paulo Alencar, Donald Cowan

AI总结:

本文通过GPT-4对患者访谈转录进行抑郁二分类评估,比较不同提示复杂度和温度设置的影响,发现低温下复杂提示性能最优,但高温时性能不可预测,提示需仔细校准模型参数。

摘要:

抑郁症已影响全球数百万人,并已成为最普遍的精神障碍之一。早期精神障碍检测可为公共卫生机构节省成本,并避免其他主要共病的发生。此外,专业人员的短缺是一个关键问题,因为临床抑郁症诊断高度依赖专家专业人员且耗时较长。在本研究中,我们探索使用GPT-4基于访谈转录分析进行临床抑郁症评估。我们考察该模型将患者访谈分类为二元类别(抑郁和未抑郁)的能力。我们进行了比较分析,考虑了提示复杂度(例如,同时使用简单提示和复杂提示)以及不同的温度设置,以评估提示复杂度和随机性对模型性能的影响。结果表明,GPT-4在不同配置下的准确率和F1分数表现出相当大的变异性,在较低温度值(0.0-0.2)下使用复杂提示时观察到最优性能。然而,超过某一阈值(温度>=0.3)后,随机性与性能之间的关系变得不可预测,削弱了提示复杂度带来的收益。这些发现表明,尽管GPT-4在临床评估中显示出前景,但提示和模型参数的配置需要仔细校准以确保结果的一致性。这项初步研究有助于理解提示工程与大语言模型之间的动态关系,为未来在临床环境中开发人工智能驱动的工具提供了见解。

英文摘要:

Depression has impacted millions of people worldwide and has become one of the most prevalent mental disorders. Early mental disorder detection can lead to cost savings for public health agencies and avoid the onset of other major comorbidities. Additionally, the shortage of specialized personnel is a critical issue because clinical depression diagnosis is highly dependent on expert professionals and is time consuming. In this study, we explore the use of GPT-4 for clinical depression assessment based on transcript analysis. We examine the model's ability to classify patient interviews into binary categories: depressed and not depressed. A comparative analysis is conducted considering prompt complexity (e.g., using both simple and complex prompts) as well as varied temperature settings to assess the impact of prompt complexity and randomness on the model's performance. Results indicate that GPT-4 exhibits considerable variability in accuracy and F1-Score across configurations, with optimal performance observed at lower temperature values (0.0-0.2) for complex prompts. However, beyond a certain threshold (temperature >= 0.3), the relationship between randomness and performance becomes unpredictable, diminishing the gains from prompt complexity. These findings suggest that, while GPT-4 shows promise for clinical assessment, the configuration of the prompts and model parameters requires careful calibration to ensure consistent results. This preliminary study contributes to understanding the dynamics between prompt engineering and large language models, offering insights for future development of AI-powered tools in clinical settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑