arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2405.09552eess.IVcs.AIcs.CV
收藏

ODFormer:用于视神经乳头检测的基于Transformer的语义眼底图像分割

ODFormer: Semantic Fundus Image Segmentation Using Transformer for Optic Nerve Head Detection

College of Electronics & Information Engineering, Tongji University(同济大学电子与信息工程学院);Shanghai Institute of Intelligent Science and Technology, Tongji University(同济大学上海智能科学与技术研究院);School of Life Science, Shanghai University(上海大学生命科学学院);Tongji Hospital, School of Medicine, Tongji University(同济大学医学院附属同济医院)

Jiayi Wang, Yi-An Mao, Xiaoyu Ma, Sicen Guo, Yuting Shao, Xiao Lv, Wenting Han, Mark Christopher, Linda M. Zangwill, Yanlong Bi, Rui Fan

AI总结:

针对眼底图像数据集差异导致的视神经乳头检测泛化难题,提出基于Swin Transformer并含多尺度上下文聚合器与轻量级双向特征重校准器的ODFormer网络,发布多分辨率数据集TongjiU-DROD并建立综合基准,实验证明其在性能与泛化性上优于现有方法。

摘要:

多年来,视神经乳头(ONH)检测一直是眼科研究的重要领域。然而,眼底图像数据集之间存在显著差异,每个数据集均由单一类型的眼底相机生成,这给基于语义分割网络开发的ONH检测方法的泛化能力带来了挑战。尽管近期在使用卷积神经网络(CNNs)和Transformers的通用语义分割方法上取得了诸多进展,但目前仍缺乏专门针对ONH检测训练的这些最先进(SoTA)网络的基准。因此,本文从三个关键方面做出贡献:网络设计、数据集发布以及综合基准的建立。我们新开发的ONH检测网络称为ODFormer,基于Swin Transformer架构,并包含两个新颖组件:多尺度上下文聚合器和轻量级双向特征重校准器。我们发布的大规模数据集名为TongjiU-DROD,为每位受试者提供多分辨率眼底图像,这些图像使用两种不同类型的相机拍摄。我们建立的基准涉及三个数据集:DRIONS-DB、DRISHTI-GS1和TongjiU-DROD,它们由不同国家的研究人员创建,包含从不同种族和年龄的受试者中拍摄的眼底图像。大量实验结果表明,我们提出的ODFormer在性能和泛化能力上均优于其他最先进(SoTA)网络。我们的数据集和源代码已在mias.group/ODFormer上公开。

英文摘要:

Optic nerve head (ONH) detection has been a crucial area of study in ophthalmology for years. However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks. Despite the numerous recent advancements in general-purpose semantic segmentation methods using convolutional neural networks (CNNs) and Transformers, there is currently a lack of benchmarks for these state-of-the-art (SoTA) networks specifically trained for ONH detection. Therefore, in this article, we make contributions from three key aspects: network design, the publication of a dataset, and the establishment of a comprehensive benchmark. Our newly developed ONH detection network, referred to as ODFormer, is based upon the Swin Transformer architecture and incorporates two novel components: a multi-scale context aggregator and a lightweight bidirectional feature recalibrator. Our published large-scale dataset, known as TongjiU-DROD, provides multi-resolution fundus images for each participant, captured using two distinct types of cameras. Our established benchmark involves three datasets: DRIONS-DB, DRISHTI-GS1, and TongjiU-DROD, created by researchers from different countries and containing fundus images captured from participants of diverse races and ages. Extensive experimental results demonstrate that our proposed ODFormer outperforms other state-of-the-art (SoTA) networks in terms of performance and generalizability. Our dataset and source code are publicly available at mias.group/ODFormer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑