arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.02779cs.CV

基于无监督深度学习的关键点定位:描述符匹配性能估计

Unsupervised Deep Learning-based Keypoint Localization Estimating Descriptor Matching Performance

Grupo VARPA(VARPA组);Instituto de Investigacion Biomédica de A Coruña (INIBIC)(阿罗纳生物医学研究所(INIBIC));Universidade da Coruña(科鲁纳大学);Departamento de Ciencias de la Computación y Tecnologías de la Información(计算机科学与信息技术部门)

David Rivas-Villar, Álvaro S. Hervella, José Rouco, Jorge Novo

AI总结:

本研究提出一种无监督视网膜图像配准流程,通过创新的无标注描述符学习与关键点检测器网络,实现了与领先有监督方法相当的性能,可适配其他领域和模态。

摘要:

视网膜图像配准,尤其是彩色眼底图像的配准,是一项具有挑战性但又至关重要的任务,拥有多种临床应用场景。现有的彩色眼底图像配准方法通常依赖关键点和描述符进行对齐,但一个显著的局限性是它们依赖标注数据,而这类数据在医疗领域尤为稀缺。在本研究中,我们提出了一种全新的无监督配准流程,完全消除了对标注数据的需求。我们的方法基于这样一个原理:具有独特描述符的位置构成可靠的关键点,这完全颠覆了当前最先进方法的常规思路,将检测器的条件设定为描述符而非相反。首先,我们提出了一种创新的描述符学习方法,该方法无需关键点检测或任何标注,可生成视网膜图像中任意位置的描述符。接下来,我们引入了一种新颖的无标注关键点检测器网络,该网络通过直接从输入图像中估计描述符性能来工作。我们通过对四个保留数据集的综合评估验证了我们的方法,结果表明,我们的无监督描述符优于最先进的有监督描述符,且我们的无监督检测器显著优于现有的无监督检测方法。最后,我们的完整配准流程实现了与领先的有监督方法相当的性能,同时不使用任何标注数据。此外,我们方法的无标注特性和设计使其能够直接适配其他领域和模态。

英文摘要:

Retinal image registration, particularly for color fundus images, is a challenging yet essential task with diverse clinical applications. Existing registration methods for color fundus images typically rely on keypoints and descriptors for alignment; however, a significant limitation is their reliance on labeled data, which is particularly scarce in the medical domain. In this work, we present a novel unsupervised registration pipeline that entirely eliminates the need for labeled data. Our approach is based on the principle that locations with distinctive descriptors constitute reliable keypoints. This fully inverts the conventional state-of-the-art approach, conditioning the detector on the descriptor rather than the opposite. First, we propose an innovative descriptor learning method that operates without keypoint detection or any labels, generating descriptors for arbitrary locations in retinal images. Next, we introduce a novel, label-free keypoint detector network which works by estimating descriptor performance directly from the input image. We validate our method through a comprehensive evaluation on four hold-out datasets, demonstrating that our unsupervised descriptor outperforms state-of-the-art supervised descriptors and that our unsupervised detector significantly outperforms existing unsupervised detection methods. Finally, our full registration pipeline achieves performance comparable to the leading supervised methods, while not employing any labeled data. Additionally, the label-free nature and design of our method enable direct adaptation to other domains and modalities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑