arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.21944cs.CV
收藏

学习多视图图融合与重建以进行糖尿病视网膜病变分级

Learning to Fuse and Reconstruct Multi-View Graphs for Diabetic Retinopathy Grading

Department of Data Science and Artificial Intelligence, Monash University(数据科学与人工智能系,墨尔本大学);ARC Centre of Excellence for the Weather of the 21st Century(21世纪天气卓越研究中心);School of Computing and Information Technology, University of Wollongong(计算与信息科技学院,沃林戈大学);Shenzhen Key Laboratory of Visual Object Detection and Recognition, Harbin Institute of Technology (Shenzhen)(深圳视觉目标检测与识别重点实验室,哈尔滨工业大学(深圳));College of Computer Science and Software Engineering, Shenzhen University(计算机科学与软件工程学院,深圳大学);College of Artificial Intelligence, Nanjing University of Aeronautics and Astronautics(人工智能学院,南京航空航天大学);Centre for Nutrition and Food Sciences, The University of Queensland(营养与食品科学中心,昆士兰大学);School of Electrical and Computer Engineering, University of Sydney(电气与计算机工程学院,悉尼大学);Department of Management, Griffith University(管理学院,格里菲斯大学);NVIDIA;The University of New South Wales(新南威尔士大学)

Haoran Li, Yuxin Lin, Huan Wang, Xiaoling Luo, Qi Zhu, Jiahua Shi, Huaming Chen, Bo Du, Johan Barthelemy, Zongyan Xue, Jun Shen, Yong Xu

AI总结:

本文提出MVGFDR框架,通过多视图图融合与重建技术提升糖尿病视网膜病变分级的准确性。

摘要:

糖尿病视网膜病变(DR)是全球导致视力丧失的主要原因之一,因此及时且准确的DR分级对于及时干预至关重要。最近的临床实践利用多视图视网膜图像进行DR检测,具有广泛的视野覆盖范围,促使深度学习方法探索多视图学习在DR分级中的潜力。然而,现有方法在融合多视图视网膜图像时往往忽视视图间的相关性,未能充分利用来自同一名患者的不同视图之间固有的一致性。在本工作中,我们提出了MVGFDR,一种用于DR分级的端到端多视图图融合框架。与现有方法直接融合多个视图的视觉特征不同,MVGFDR配备了新的多视图图融合(MVGF)模块,以显式分离共享的和视图特定的视觉特征。具体而言,MVGF包含三个关键组件:(1)多视图图初始化,通过残差引导的连接构建视觉图,并使用离散余弦变换(DCT)系数作为频域锚点;(2)多视图图融合,基于频域相关性在多视图图中整合选择性节点,以捕捉互补的视图特定信息;(3)掩码跨视图重建,利用跨视图共享信息的掩码重建以促进视图不变的表示学习。在MFIDDR上进行的大量实验结果表明,我们的方法在糖尿病视网膜病变分级中优于现有的最先进方法。

英文摘要:

Diabetic retinopathy (DR) is one of the leading causes of vision loss worldwide, making early and accurate DR grading critical for timely intervention. Recent clinical practices leverage multi-view fundus images for DR detection with a wide coverage of the field of view (FOV), motivating deep learning methods to explore the potential of multi-view learning for DR grading. However, existing methods often overlook the inter-view correlations when fusing multi-view fundus images, failing to fully exploit the inherent consistency across views originating from the same patient. In this work, we present MVGFDR, an end-to-end Multi-View Graph Fusion framework for DR grading. Different from existing methods that directly fuse visual features from multiple views, MVGFDR is equipped with a novel Multi-View Graph Fusion (MVGF) module to explicitly disentangle the shared and view-specific visual features. Specifically, MVGF comprises three key components: (1) Multi-view Graph Initialization, which constructs visual graphs via residual-guided connections and employs Discrete Cosine Transform (DCT) coefficients as frequency-domain anchors; (2) Multi-view Graph Fusion, which integrates selective nodes across multi-view graphs based on frequency-domain relevance to capture complementary view-specific information; and (3) Masked Cross-view Reconstruction, which leverages masked reconstruction of shared information across views to facilitate view-invariant representation learning. Extensive experimental results on MFIDDR, by far the largest multi-view fundus image dataset, demonstrate the superiority of our proposed approach over existing state-of-the-art approaches in diabetic retinopathy grading.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑