arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.04763cs.CVcs.AIcs.LG

评估GPT-5作为多模态临床推理者的有效性:领域评论

Evaluating GPT-5 as a Multimodal Clinical Reasoner: A Landscape Commentary

Department of Radiation Oncology, Winship Cancer Institute, Emory University School of Medicine(放射肿瘤科,Winship癌症研究所,埃默里大学医学院);Department of Biomedical Engineering, Georgia Institute of Technology(生物医学工程系,佐治亚理工学院)

Alexandru Florea, Shansong Wang, Mingzhe Hu, Qiang Li, Zach Eidex, Luke del Balzo, Mojtaba Safari, Xiaofeng Yang

AI总结:

本文评估GPT-5在多模态临床推理中的表现,发现其在文本推理和部分视觉问答任务中优于GPT-4o,但在神经放射学和乳腺摄影等专业领域仍显不足。

摘要:

从任务特定的人工智能向通用基础模型的转变引发了关于其在临床医学中支持所需整合推理能力的根本问题,其中诊断要求综合模糊的患者叙述、实验室数据和多模态成像。这项领域评论提供了首次受控的横断面评估,比较GPT-5家族(GPT-5、GPT-5 Mini、GPT-5 Nano)与其前身GPT-4o在一系列临床相关任务上的表现,包括医学教育考试、基于文本的推理基准测试以及在神经放射学、数字病理学和乳腺摄影中的视觉问答任务,使用标准化的零样本链式思维协议。GPT-5在专家级文本推理上表现出显著提升,在MedXpertQA上绝对改进超过25个百分点。当被要求进行多模态合成时,GPT-5有效地利用了这种增强的推理能力,将不确定的临床叙述扎根于具体的影像证据中,在大多数VQA基准测试中达到最先进的或竞争性的表现,并在需要细粒度病变表征的乳腺摄影任务中超越GPT-4o,以10-40%的差距。然而,在神经放射学(44%的宏平均准确率)中的表现仍然中等,在乳腺摄影中落后于专门系统,后者在准确性上超过80%,而GPT-5仅为52-64%。这些发现表明,尽管GPT-5在整合多模态临床推理方面取得了显著进展,模仿临床医生偏袒不确定信息以客观发现的认知过程,但通用模型尚未成为在高度专业化、感知关键任务中的专用系统的替代品。

英文摘要:

The transition from task-specific artificial intelligence toward general-purpose foundation models raises fundamental questions about their capacity to support the integrated reasoning required in clinical medicine, where diagnosis demands synthesis of ambiguous patient narratives, laboratory data, and multimodal imaging. This landscape commentary provides the first controlled, cross-sectional evaluation of the GPT-5 family (GPT-5, GPT-5 Mini, GPT-5 Nano) against its predecessor GPT-4o across a diverse spectrum of clinically grounded tasks, including medical education examinations, text-based reasoning benchmarks, and visual question-answering in neuroradiology, digital pathology, and mammography using a standardized zero-shot chain-of-thought protocol. GPT-5 demonstrated substantial gains in expert-level textual reasoning, with absolute improvements exceeding 25 percentage-points on MedXpertQA. When tasked with multimodal synthesis, GPT-5 effectively leveraged this enhanced reasoning capacity to ground uncertain clinical narratives in concrete imaging evidence, achieving state-of-the-art or competitive performance across most VQA benchmarks and outperforming GPT-4o by margins of 10-40% in mammography tasks requiring fine-grained lesion characterization. However, performance remained moderate in neuroradiology (44% macro-average accuracy) and lagged behind domain-specific models in mammography, where specialized systems exceed 80% accuracy compared to GPT-5's 52-64%. These findings indicate that while GPT-5 represents a meaningful advance toward integrated multimodal clinical reasoning, mirroring the clinician's cognitive process of biasing uncertain information with objective findings, generalist models are not yet substitutes for purpose-built systems in highly specialized, perception-critical tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑