arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.10331eess.IVcs.CV
收藏

利用多模态融合增强超广角OCTA中多种视网膜疾病的诊断

Leveraging Multimodal Fusion for Enhanced Diagnosis of Multiple Retinal Diseases in Ultra-wide OCTA

The Chinese University of Hong Kong(香港中文大学)

Hao Wei, Peilun Shi, Guitao Bai, Minqing Zhang, Shuangle Li, Wu Yuan

AI总结:

针对UW-OCTA数据信息有限的问题,构建首个多模态多疾病M3OCTA数据集,并提出跨模态融合框架,实验证明其在多种视网膜疾病诊断中的有效性与优越性能。

摘要:

超广角光学相干断层扫描血管成像(UW-OCTA)是一种新兴的成像技术,通过提供高达24 x 20 $mm^{2}$的超宽扫描范围,覆盖视网膜前部和后部区域,相较于传统OCTA具有显著优势。然而,目前可获取的UW-OCTA数据集存在全面的分层信息及相应疾病标注有限的问题。为解决这一局限,我们构建了开创性的M3OCTA数据集,这是首个多模态(即多层)、多疾病且视野最宽的UW-OCTA数据集。此外,有效利用UW-OCTA的多层超广角眼部血管信息仍未被充分开发。为应对这一挑战,我们提出了首个跨模态融合框架,利用多模态信息诊断多种疾病。通过在我们公开可用的M3OCTA数据集上进行的大量实验,我们证明了该方法在固定和变化模态设置下的有效性和优越性能。M3OCTA数据集作为首个涵盖多种疾病的多模态OCTA数据集的构建,旨在推动眼科图像分析社区的研究进展。

英文摘要:

Ultra-wide optical coherence tomography angiography (UW-OCTA) is an emerging imaging technique that offers significant advantages over traditional OCTA by providing an exceptionally wide scanning range of up to 24 x 20 $mm^{2}$, covering both the anterior and posterior regions of the retina. However, the currently accessible UW-OCTA datasets suffer from limited comprehensive hierarchical information and corresponding disease annotations. To address this limitation, we have curated the pioneering M3OCTA dataset, which is the first multimodal (i.e., multilayer), multi-disease, and widest field-of-view UW-OCTA dataset. Furthermore, the effective utilization of multi-layer ultra-wide ocular vasculature information from UW-OCTA remains underdeveloped. To tackle this challenge, we propose the first cross-modal fusion framework that leverages multi-modal information for diagnosing multiple diseases. Through extensive experiments conducted on our openly available M3OCTA dataset, we demonstrate the effectiveness and superior performance of our method, both in fixed and varying modalities settings. The construction of the M3OCTA dataset, the first multimodal OCTA dataset encompassing multiple diseases, aims to advance research in the ophthalmic image analysis community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑