arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.02046cs.CV
收藏

用于子宫内膜异位症诊断的人机协作多模态多评估者学习

Human-AI Collaborative Multi-modal Multi-rater Learning for Endometriosis Diagnosis

The University of Adelaide(阿德莱德大学);Benson Radiology(本森放射科);Macquarie University(麦考瑞大学);University of Surrey(萨里大学)

Hu Wang, David Butler, Yuan Zhang, Jodie Avery, Steven Knox, Congbo Ma, Louise Hull, Gustavo Carneiro

AI总结:

针对MRI诊断POD闭塞时标签含噪、单模态及独立人机判断受限的问题,提出HAICOMM框架,融合多评估者、多模态和人机协作学习,性能优于临床医生集成及现有方法。

摘要:

子宫内膜异位症影响约10%出生时被指派为女性的个体,其诊断和管理颇具挑战。诊断通常需要通过腹腔镜手术或分析T1/T2 MRI图像来识别该疾病的多种征象,后者更快捷、成本更低,但准确性较差。子宫内膜异位症的一个关键诊断征象是子宫直肠陷凹(Pouch of Douglas,POD)闭塞。然而,即使是经验丰富的临床医生,也难以根据MRI图像准确分类POD闭塞,这使得训练可靠的AI模型变得复杂。本文提出人机协作多模态多评估者学习(Human-AI Collaborative Multi-modal Multi-rater Learning,HAICOMM)方法来应对上述挑战。HAICOMM是首个探索该问题三个重要方面的方法:1)多评估者学习,从每个训练样本可用的多个“噪声”标签中提取更干净的标签;2)多模态学习,在训练和测试中利用T1/T2 MRI图像;3)人机协作,构建一个利用临床医生和AI模型预测结果的系统,以提供比独立临床医生和AI模型更准确的分类。在我们为验证该方法而收集的多评估者T1/T2 MRI子宫内膜异位症数据集上,所提出的HAICOMM模型表现优于临床医生集成、噪声标签学习模型以及多评估者学习方法。

英文摘要:

Endometriosis, affecting about 10% of individuals assigned female at birth, is challenging to diagnose and manage. Diagnosis typically involves the identification of various signs of the disease using either laparoscopic surgery or the analysis of T1/T2 MRI images, with the latter being quicker and cheaper but less accurate. A key diagnostic sign of endometriosis is the obliteration of the Pouch of Douglas (POD). However, even experienced clinicians struggle with accurately classifying POD obliteration from MRI images, which complicates the training of reliable AI models. In this paper, we introduce the Human-AI Collaborative Multi-modal Multi-rater Learning (HAICOMM) methodology to address the challenge above. HAICOMM is the first method that explores three important aspects of this problem: 1) multi-rater learning to extract a cleaner label from the multiple "noisy" labels available per training sample; 2) multi-modal learning to leverage the presence of T1/T2 MRI images for training and testing; and 3) human-AI collaboration to build a system that leverages the predictions from clinicians and the AI model to provide more accurate classification than standalone clinicians and AI models. Presenting results on the multi-rater T1/T2 MRI endometriosis dataset that we collected to validate our methodology, the proposed HAICOMM model outperforms an ensemble of clinicians, noisy-label learning models, and multi-rater learning methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑