arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.22001eess.IVcs.AIcs.CV

当领域特定基础模型是否值得其成本?跨视网膜成像任务的系统评估

When Do Domain-Specific Foundation Models Justify Their Cost? A Systematic Evaluation Across Retinal Imaging Tasks

Stadtspital Zürich Department of Ophthalmology(苏黎世城市医院眼科部);Spross Research Institute(斯普罗斯研究所)

David Isztl, Tahm Spitznagel, Gabor Mark Somfai, Rui Santos

AI总结:

本文通过系统评估发现,紧凑型通用模型在大多数视网膜分类任务中表现优异,而专门领域模型仅在特定高难度任务中值得其成本。

摘要:

大规模视觉基础模型已被广泛用于视网膜疾病分类,但缺乏系统性证据证明其参数需求的合理性。在本研究中,我们针对两个关键问题进行探讨:首先,大规模领域特定基础模型是否是必需的,还是紧凑型通用架构就足够?其次,专门针对视网膜的预训练是否值得其计算成本?为回答这些问题,我们在四个涵盖光学相干断层扫描(OCT)和彩色视网膜摄影(CFP)模态的视网膜成像分类任务中基准测试初始化策略:8类OCT分类、3类糖尿病性黄斑水肿(DME)、5类糖尿病视网膜病变(DR)和3类青光眼(GL)检测。我们评估了每个任务12-13种模型配置,包括视觉Transformer(22.8M-86.6M参数)、Swin Transformer(27.6M-28.3M)、ConvNeXt(28.6M)以及领域特定的RETFound模型(303M),在相同的训练条件下。我们的结果挑战了普遍的假设:首先,我们证明预训练提供了普遍的好处(5.18-18.41%的提升),并且随着任务难度的增加而扩大。其次,紧凑型架构(27-29M)主导了帕累托前沿;SwinV2-tiny在三个数据集上实现了顶级性能。第三,RETFound(303M)仅在具有挑战性的DR分级(准确率为71.15%)中证明了其计算成本的合理性,而ImageNet预训练在其他所有任务中证明是足够的(DME准确率:99.24%,OCT准确率:97.96%)。CFP任务显示出比OCT更大的预训练准确率提升(9.13-18.41%)比OCT(5.18%)。因此,证据表明,紧凑型通用模型在大多数视网膜分类任务中可以提供接近最优的性能;只有在极端类别不平衡的情况下,才需要专门的基础模型进行精细区分。

英文摘要:

Large vision foundation models have been widely adopted for retinal disease classification without systematic evidence justifying their parameter requirements. In the present work we address two critical questions: First, are large domain-specific foundation models essential, or do compact general-purpose architectures suffice? Second, does specialized retinal pretraining justify its computational cost? To answer this, we benchmark initialization strategies across four retinal imaging classification tasks spanning Optical Coherence Tomography (OCT) and Color Fundus Photography (CFP) modalities: 8-class OCT classification, 3-class diabetic macular edema (DME), 5-class diabetic retinopathy (DR), and 3-class glaucoma (GL) detection. We evaluate 12-13 model configurations per task, including vision transformers (22.8M-86.6M parameters), Swin Transformers (27.6M-28.3M), ConvNeXt (28.6M), and the domain-specific RETFound models (303M), under identical training conditions. Our results challenge prevailing assumptions: First, we demonstrate that pretraining provides universal benefits (5.18-18.41% improvement), scaling with task difficulty. Second, compact architectures (27-29M) dominate Pareto frontiers; SwinV2-tiny achieves top-1 performance on three datasets. Third, RETFound (303M) justifies its computational cost only for challenging DR grading (accuracy of 71.15%), while ImageNet pretraining proves to be sufficient with all other tasks (DME accuracy: 99.24%, OCT accuracy: 97.96%). CFP tasks show larger pretraining accuracy gains (9.13-18.41%) than OCT (5.18%). Thus, the evidence suggests that compact general-purpose models deliver near-optimal performance for most retinal classification tasks; specialized foundation models warranted only for fine-grained discrimination under extreme class imbalance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑