arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09718cs.CVcs.RO
收藏

CLOVER:上下文感知的长期目标视角与环境不变表示学习

CLOVER: Context-aware Long-term Object Viewpoint- and Environment- Invariant Representation Learning

Department of Computer Science, The University of Texas at Austin(计算机科学系,德克萨斯大学奥斯汀分校)

Dongmyeong Lee, Amanda Adkins, Joydeep Biswas

AI总结:

针对移动机器人对象重识别在视角和光照变化下的挑战,提出CLOVER表示学习方法及CODa Re-ID数据集,无需前景分割即可区分静态对象实例,并实现优越性能与泛化能力。

摘要:

移动服务机器人可以从其环境的对象级理解中受益,包括区分对象实例和重新识别先前见过的实例的能力。对象重识别在不同视角以及由天气或光照变化引起的显著外观变化的场景中具有挑战性。现有的对象重识别工作要么专注于特定类别,要么需要前景分割。此外,这些方法以及对象重识别数据集,对户外场景和光照变化等挑战的考虑有限。为了解决这个问题,我们引入了CODa Re-ID:一个野外对象重识别数据集,包含在多样化光照条件和视角下8个类别的557个对象的1,037,814个观测。此外,我们提出了CLOVER,一种用于对象观测的表示学习方法,可以在不需要前景分割的情况下区分静态对象实例。我们还引入了MapCLOVER,一种可扩展地总结CLOVER描述符以用于对象地图并将新观测与总结描述符匹配的方法。我们的结果表明,CLOVER在变化光照条件和视角变化下的静态对象重识别中实现了优越的性能,并且可以泛化到未见过的实例和类别。

英文摘要:

Mobile service robots can benefit from object-level understanding of their environments, including the ability to distinguish object instances and re-identify previously seen instances. Object re-identification is challenging across different viewpoints and in scenes with significant appearance variation arising from weather or lighting changes. Existing works on object re-identification either focus on specific classes or require foreground segmentation. Further, these methods, along with object re-identification datasets, have limited consideration of challenges such as outdoor scenes and illumination changes. To address this problem, we introduce CODa Re-ID: an in-the-wild object re-identification dataset containing 1,037,814 observations of 557 objects across 8 classes under diverse lighting conditions and viewpoints. Further, we propose CLOVER, a representation learning method for object observations that can distinguish between static object instances without requiring foreground segmentation. We also introduce MapCLOVER, a method for scalably summarizing CLOVER descriptors for use in object maps and matching new observations to summarized descriptors. Our results show that CLOVER achieves superior performance in static object re-identification under varying lighting conditions and viewpoint changes and can generalize to unseen instances and classes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑