arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.04718cs.CVcs.LG

用于胰腺内镜超声图像分割的跨器官域自适应神经网络

Cross-Organ Domain Adaptive Neural Network for Pancreatic Endoscopic Ultrasound Image Segmentation

School of Computer Science and Engineering, Southeast University(东南大学计算机科学与工程学院);Pancreas Centre, First Affiliated Hospital, Nanjing Medical University(南京医科大学第一附属医院胰腺中心);Department of General Surgery, First Affiliated Hospital, Nanjing Medical University(南京医科大学第一附属医院普外科);Big Data Computing Center of Southeast University(东南大学大数据计算中心)

ZhiChao Yan, Hui Xue, Yi Zhu, Bin Xiao, Hao Yuan

AI总结:

针对胰腺EUS图像稀缺及跨器官域差距问题,本文提出由通用网络和辅助网络构成的COTS-Nets,并构建含501张图像的PCEUS数据集,显著提升胰腺癌分割诊断准确性。

摘要:

在胰腺内镜超声(EUS)图像中准确分割病灶对于有效诊断和治疗至关重要。然而,收集足够清晰、可用于有效诊断的EUS图像十分困难。近年来,域自适应(DA)被用于通过利用来自其他域的相关知识来应对这些挑战。大多数DA方法只关注同一器官的多视图表示,这使得在语义信息有限的情况下仍难以清晰描绘肿瘤病灶区域。尽管迁移来自不同器官的同质相似性可能有助于解决该问题,但由于不同器官之间存在巨大的域差距,相关工作仍然缺乏。为应对这些挑战,我们提出了跨器官肿瘤分割网络(Cross-Organ Tumor Segmentation Networks,COTS-Nets),该网络由一个通用网络和一个辅助网络组成。通用网络利用边界损失学习不同肿瘤的共同边界信息,从而在数据有限且质量较低的情况下仍能准确描绘EUS中的肿瘤。同时,我们在通用网络中引入一致性损失,使胰腺EUS的预测与来自其他器官的肿瘤边界对齐,以缓解域差距。为进一步缩小跨器官域差距,辅助网络整合来自不同器官的多尺度特征,帮助通用网络获得域不变知识。系统性实验表明,COTS-Nets显著提高了胰腺癌诊断的准确性。此外,我们构建了胰腺癌内镜超声(Pancreatic Cancer Endoscopic Ultrasound,PCEUS)数据集,其中包含501张经病理证实的胰腺EUS图像,以促进模型开发。

英文摘要:

Accurate segmentation of lesions in pancreatic endoscopic ultrasound (EUS) images is crucial for effective diagnosis and treatment. However, the collection of enough crisp EUS images for effective diagnosis is arduous. Recently, domain adaptation (DA) has been employed to address these challenges by leveraging related knowledge from other domains. Most DA methods only focus on multi-view representations of the same organ, which makes it still tough to clearly depict the tumor lesion area with limited semantic information. Although transferring homogeneous similarity from different organs could benefit the issue, there is a lack of relevant work due to the enormous domain gap between them. To address these challenges, we propose the Cross-Organ Tumor Segmentation Networks (COTS-Nets), consisting of a universal network and an auxiliary network. The universal network utilizes boundary loss to learn common boundary information of different tumors, enabling accurate delineation of tumors in EUS despite limited and low-quality data. Simultaneously, we incorporate consistency loss in the universal network to align the prediction of pancreatic EUS with tumor boundaries from other organs to mitigate the domain gap. To further reduce the cross-organ domain gap, the auxiliary network integrates multi-scale features from different organs, aiding the universal network in acquiring domain-invariant knowledge. Systematic experiments demonstrate that COTS-Nets significantly improves the accuracy of pancreatic cancer diagnosis. Additionally, we developed the Pancreatic Cancer Endoscopic Ultrasound (PCEUS) dataset, comprising 501 pathologically confirmed pancreatic EUS images, to facilitate model development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑