ELF:一种用于青光眼分级的端到端局部与全局多模态融合框架
ELF: An End-to-end Local and Global Multimodal Fusion Framework for Glaucoma Grading
AI总结:
针对青光眼分级,提出端到端局部与全局多模态融合框架ELF,充分利用眼底图像与OCT的互补信息及局部和全局相互信息,在GAMMA数据集上验证了其有效性。
摘要:
青光眼是一种慢性神经退行性疾病,可导致失明。对于青光眼患者而言,早期检测和治愈对于阻止病情恶化非常重要。二维眼底图像和光学相干断层扫描(OCT)有助于眼科医生诊断青光眼。目前已有许多基于眼底图像或三维OCT体积的方法;然而,对包括眼底图像和OCT数据在内的多模态信息的挖掘研究较少。在本工作中,我们提出了一种用于青光眼分级的端到端局部与全局多模态融合框架,简称ELF。ELF能够充分利用眼底图像与OCT之间的互补信息。此外,与以往将多模态特征直接拼接、缺乏探索不同模态间相互信息的方法不同,ELF能够利用局部和全局的相互信息。在多模态青光眼分级GAMMA数据集上进行的大量实验证明,与其他最先进的方法相比,ELF的有效性得到了验证。
英文摘要:
Glaucoma is a chronic neurodegenerative condition that can lead to blindness. Early detection and curing are very important in stopping the disease from getting worse for glaucoma patients. The 2D fundus images and optical coherence tomography(OCT) are useful for ophthalmologists in diagnosing glaucoma. There are many methods based on the fundus images or 3D OCT volumes; however, the mining for multi-modality, including both fundus images and data, is less studied. In this work, we propose an end-to-end local and global multi-modal fusion framework for glaucoma grading, named ELF for short. ELF can fully utilize the complementary information between fundus and OCT. In addition, unlike previous methods that concatenate the multi-modal features together, which lack exploring the mutual information between different modalities, ELF can take advantage of local-wise and global-wise mutual information. The extensive experiment conducted on the multi-modal glaucoma grading GAMMA dataset can prove the effiectness of ELF when compared with other state-of-the-art methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。