arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2003.12059cs.CV
收藏

具有自适应邻域一致性的对应网络

Correspondence Networks with Adaptive Neighbourhood Consensus

University of Oxford(牛津大学)

Shuda Li, Kai Han, Theo W. Costain, Henry Howard-Jenkins, Victor Prisacariu

摘要:

在本文中,我们解决的任务,建立密集的视觉对应图像包含相同类别的对象之间。这是一个具有挑战性的任务,由于大的类内变化和缺乏密集的像素级注释。我们提出了一个卷积神经网络架构,称为自适应邻域共识网络(ANC-Net),可以用稀疏的关键点注释进行端到端的训练,以应对这一挑战。ANC-Net的核心是我们提出的非各向同性4D卷积核,它构成了用于鲁棒匹配的自适应邻域一致性模块的构建块。我们还在ANC-Net中引入了一个简单有效的多尺度自相似模块,使学习的特征对类内变化具有鲁棒性。此外,我们提出了一种新的正交损失,可以执行一对一的匹配约束。我们彻底评估了我们的方法在各种基准上的有效性,它大大优于最先进的方法。

英文摘要:

In this paper, we tackle the task of establishing dense visual correspondences between images containing objects of the same category. This is a challenging task due to large intra-class variations and a lack of dense pixel level annotations. We propose a convolutional neural network architecture, called adaptive neighbourhood consensus network (ANC-Net), that can be trained end-to-end with sparse key-point annotations, to handle this challenge. At the core of ANC-Net is our proposed non-isotropic 4D convolution kernel, which forms the building block for the adaptive neighbourhood consensus module for robust matching. We also introduce a simple and efficient multi-scale self-similarity module in ANC-Net to make the learned feature robust to intra-class variations. Furthermore, we propose a novel orthogonal loss that can enforce the one-to-one matching constraint. We thoroughly evaluate the effectiveness of our method on various benchmarks, where it substantially outperforms state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑