arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.09354cs.CVcs.AIcs.LG
收藏

NCI 影像数据共享平台作为计算病理学可重复研究平台

The NCI Imaging Data Commons as a platform for reproducible research in computational pathology

Fraunhofer Institute for Digital Medicine MEVIS(弗劳恩霍夫数字医学研究所MEVIS);Department of Pathology, Massachusetts General Hospital(麻省总医院病理科部门);Harvard Medical School(哈佛医学院);Institute for Systems Biology(系统生物学研究所)

Daniela P. Schacherer, Markus D. Herrmann, David A. Clunie, Henning Höfener, William Clifford, William J. R. Longabaugh, Steve Pieper, Ron Kikinis, Andrey Fedorov, André Homeyer

AI总结:

本文探讨 NCI 影像数据共享平台如何通过提供 FAIR 数据集和云 ML 服务集成,促进计算病理学研究的可重复性,实验显示 AUC 差异最高达 0.045。

摘要:

背景与目标:在计算病理学(CompPath)中开发基于机器学习(ML)的解决方案时,可重复性是一个重大挑战。NCI 影像数据共享(IDC)根据 FAIR 原则提供了超过 120 个癌症影像数据集,并设计用于与云 ML 服务配合使用。在此,我们探讨其在促进 CompPath 研究可重复性方面的潜力。方法:利用 IDC,我们实施了两个实验,其中一个具有代表性的基于 ML 的肺肿瘤组织分类方法在不同数据集上进行训练和/或评估。为了评估可重复性,实验在常见 ML 服务的独立但配置相同的实例上多次运行。结果:同一实验不同运行的 AUC 值总体一致。然而,我们观察到 AUC 值存在高达 0.045 的微小差异,表明可重复性存在实际限制。结论:我们得出结论,IDC 通过使研究人员能够重用完全相同的数据集,并与云 ML 服务集成,使实验能够在配置相同的计算环境中运行,从而有助于接近 CompPath 研究的可重复性极限。

英文摘要:

Background and Objectives: Reproducibility is a major challenge in developing machine learning (ML)-based solutions in computational pathology (CompPath). The NCI Imaging Data Commons (IDC) provides >120 cancer image collections according to the FAIR principles and is designed to be used with cloud ML services. Here, we explore its potential to facilitate reproducibility in CompPath research. Methods: Using the IDC, we implemented two experiments in which a representative ML-based method for classifying lung tumor tissue was trained and/or evaluated on different datasets. To assess reproducibility, the experiments were run multiple times with separate but identically configured instances of common ML services. Results: The AUC values of different runs of the same experiment were generally consistent. However, we observed small variations in AUC values of up to 0.045, indicating a practical limit to reproducibility. Conclusions: We conclude that the IDC facilitates approaching the reproducibility limit of CompPath research (i) by enabling researchers to reuse exactly the same datasets and (ii) by integrating with cloud ML services so that experiments can be run in identically configured computing environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑