arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.07855cs.CVcs.LG
收藏

CrIBo:通过跨图像对象级自举实现自监督学习

CrIBo: Self-Supervised Learning via Cross-Image Object-Level Bootstrapping

KU Leuven(鲁汶大学);EPFL(洛桑联邦理工学院);CHUV(洛桑大学医院)

Tim Lebailly, Thomas Stegmüller, Behzad Bozorgtabar, Jean-Philippe Thiran, Tinne Tuytelaars

AI总结:

本文提出CrIBo,一种跨图像对象级自举的自监督方法,通过训练中的对象级最近邻自举增强密集表示学习,并在上下文学习及下游分割任务中取得优异性能。

摘要:

利用最近邻检索进行自监督表示学习已在以对象为中心的图像上被证明是有益的。然而,这种方法在应用于以场景为中心的数据集时面临局限,因为图像内的多个对象仅在全局表示中被隐式捕获。这种全局自举可能导致不希望出现的对象表示纠缠。此外,即使是以对象为中心的数据集也能从更细粒度的自举方法中受益。为应对这些挑战,我们提出了一种新颖的跨图像对象级自举方法,旨在增强密集视觉表示学习。通过在整个训练过程中采用对象级最近邻自举,CrIBo成为上下文学习中一个显著强大且充分的候选方法,并在测试时利用最近邻检索。CrIBo在后一项任务上展现出最先进的性能,同时在更标准的下游分割任务中也具有很强的竞争力。我们的代码和预训练模型已公开发布于 https://github.com/tileb1/CrIBo。

英文摘要:

Leveraging nearest neighbor retrieval for self-supervised representation learning has proven beneficial with object-centric images. However, this approach faces limitations when applied to scene-centric datasets, where multiple objects within an image are only implicitly captured in the global representation. Such global bootstrapping can lead to undesirable entanglement of object representations. Furthermore, even object-centric datasets stand to benefit from a finer-grained bootstrapping approach. In response to these challenges, we introduce a novel Cross-Image Object-Level Bootstrapping method tailored to enhance dense visual representation learning. By employing object-level nearest neighbor bootstrapping throughout the training, CrIBo emerges as a notably strong and adequate candidate for in-context learning, leveraging nearest neighbor retrieval at test time. CrIBo shows state-of-the-art performance on the latter task while being highly competitive in more standard downstream segmentation tasks. Our code and pretrained models are publicly available at https://github.com/tileb1/CrIBo.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑