arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2412.12331cs.CVcs.MM
收藏

高效的对象中心表示学习:利用预训练几何先验

Efficient Object-centric Representation Learning with Pre-trained Geometric Prior

Dublin City University(都柏林城市大学)

Phúc H. Le Khac, Graham Healy, Alan F. Smeaton

AI总结:

提出一种利用预训练几何先验的弱监督框架,通过高效槽解码器实现无需深度信息的多对象场景表示,在合成视频基准上达到与监督方法相当的性能且保持计算效率。

摘要:

本文针对视频对象中心表示学习中的关键挑战。现有方法在处理复杂场景时存在困难,为此我们提出一种新颖的弱监督框架,该框架强调几何理解,并利用预训练视觉模型来增强对象发现。我们的方法引入了一个专为对象中心学习设计的高效槽解码器,无需显式深度信息即可有效表示多对象场景。在对象及其运动、对象遮挡和相机运动复杂度递增的合成视频基准上的结果表明,我们的方法在保持计算效率的同时,达到了与监督方法相当的性能。这推动了该领域向复杂现实世界场景中更实际的应用迈进。

英文摘要:

This paper addresses key challenges in object-centric representation learning of video. While existing approaches struggle with complex scenes, we propose a novel weakly-supervised framework that emphasises geometric understanding and leverages pre-trained vision models to enhance object discovery. Our method introduces an efficient slot decoder specifically designed for object-centric learning, enabling effective representation of multi-object scenes without requiring explicit depth information. Results on synthetic video benchmarks with increasing complexity in terms of objects and their movement, object occlusion and camera motion demonstrate that our approach achieves comparable performance to supervised methods while maintaining computational efficiency. This advances the field towards more practical applications in complex real-world scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑