arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.11540cs.HC
收藏

探索通用型自主多模态代理用于病理报告生成

Exploring General-Purpose Autonomous Multimodal Agents for Pathology Report Generation

Schwarzman Animal Medical Center(施瓦茨曼动物医疗中心);University of Veterinary Medicine, Vienna(维也纳兽医大学);Flensburg University of Applied Sciences(弗伦斯堡应用科技大学)

Marc Aubreville, Taryn A. Donovan, Christof A. Bertram

AI总结:

研究探索通用型自主多模态代理在病理报告生成中的应用,发现其在无额外信息时诊断准确率较低,但提供形态学描述时表现更佳,但仍不及人类专家。

摘要:

近年来,代理式人工智能(能够自主感知、推理和使用工具的系统)在数字病理学领域提供了新的机遇。在本试点研究中,我们评估了两种代理式多模态AI系统(OpenAI的ChatGPT 5.0在代理模式下,以及H公司的Surfer)是否能够自主导航、描述并解释数字化组织切片上的组织病理学特征。一组35个兽医病理病例(用于训练目的)被用作测试数据集。代理的任务是使用基于网页的切片查看器自主探索整个切片图像,识别显著的组织结构,生成描述性摘要,并提出初步诊断。我们通过不同的提示探索了三种场景:1)在不了解信号信息的情况下分析,2)在提供器官和物种信息的情况下分析,3)基于提供的形态学描述进行诊断。所有输出都由认证的病理学家审查和验证,以确保准确性和诊断一致性。我们进一步让另一位认证的病理学家执行相同任务,以建立基线。我们发现,系统在仅提供图像、信号信息和器官的情况下,能正确诊断多达28.6%的病例,在提供形态学描述的情况下,正确率高达68.6%。仅提供WSI的情况下,模型的正确率仅为最多5.7%。相比之下,人类专家在仅提供单个WSI的情况下,诊断准确率为85.7%,在提供信号信息和器官信息的情况下,准确率为88.6%。本研究表明,尽管代理式AI系统能够有意义地与基于网页的切片查看软件互动,以评估复杂的视觉病理学数据并生成上下文一致的特征描述,但诊断精度仍远低于人类专家。

英文摘要:

Recent advances in agentic artificial intelligence, i.e. systems capable of autonomous perception, reasoning, and tool use, offer new opportunities for digital pathology. In this pilot study, we evaluate whether two agentic multimodal AI systems (OpenAI's ChatGPT 5.0 in agentic mode, and H Company's Surfer) can autonomously navigate, describe, and interpret histopathologic features in digitized tissue slides on a slide viewing platform. A set of 35 veterinary pathology cases, curated for training purposes, was used as the test dataset. The agent was tasked with autonomously exploring whole-slide images using a web-based slide viewer, identifying salient tissue structures, generating descriptive summaries, and proposing provisional diagnoses. We fed different prompts to explore three scenarios: 1) analysis without knowledge of the signalment, 2) analysis with organ and species provided, and 3) diagnosis based on a morphological description provided. All outputs were reviewed and validated by a board-certified pathologist for accuracy and diagnostic consistency. We further tasked another board-certified pathologist with the same task to establish a baseline. We found the systems to yield accurate diagnoses in up to 28.6% of cases with only images, signalment and organ provided, and up to 68.6% when a morphological description was provided. With only the WSI provided, the models were only correct in up to 5.7% of cases. The human expert, on the other hand, achieved 85.7% diagnostic accuracy with only a single WSI, and 88.6% when also signalment and organ was provided. The study demonstrates that while the agentic AI system can meaningfully engage with web-based slide viewing software to assess complex visual pathology data and produce contextually aligned feature descriptions, diagnostic precision remains limited compared with a human expert.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑