arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.12239cs.CV
收藏

基于事件相机法向流的运动与结构恢复

Motion and Structure from Event-based Normal Flow

School of Robotics, Hunan University(湖南大学机器人学院);School of Engineering, Westlake University(西湖大学工程学院);School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院);TU Berlin(柏林工业大学);Robotics Institute Germany(德国机器人研究所)

Zhongyang Ren, Bangyan Liao, Delei Kong, Jinghang Li, Peidong Liu, Laurent Kneip, Guillermo Gallego, Yi Zhou

AI总结:

针对事件相机运动与结构恢复现有方法实时性差、敏捷运动下结果不稳定的问题,提出基于事件法向流的几何误差项,开发快速线性与连续时间非线性求解器,兼顾精度效率与运动突变适应性。

摘要:

从视觉数据中恢复相机运动和场景几何结构是计算机视觉领域的基础问题。该问题在标准视觉领域的成功得益于特征提取、数据关联和多视图几何技术的成熟。近年来,神经形态事件相机的出现对以原始事件数据为输入解决这一基础问题的方法提出了很高要求。现有最优解决方案通常通过迭代反转事件数据生成过程来隐式推断数据关联,但这类方法的非线性特性限制了其在实时任务中的适用性,且恒运动假设会导致在敏捷运动下结果不稳定。为此,我们以更契合事件相机微分工作原理的方式重新思考了该问题的公式构建。我们证明,基于事件的法向流可通过所提出的几何误差项,替代全流来解决一系列涉及瞬时一阶运动学和场景几何的几何问题。此外,我们基于该几何误差项开发了一种快速线性求解器和一种连续时间非线性求解器。在合成数据和真实数据上的实验表明,我们的线性求解器在精度和效率方面均具有优势,且可作为现有非线性求解器的初始化方法,具备互补特性。另外,我们的连续时间非线性求解器由于不依赖恒运动假设,在适应运动突变方面表现出卓越能力。

英文摘要:

Recovering the camera motion and scene geometry from visual data is a fundamental problem in the field of computer vision. Its success in standard vision is attributed to the maturity of feature extraction, data association and multi-view geometry. The recent emergence of neuromorphic event-based cameras places great demands on approaches that use raw event data as input to solve this fundamental problem. Existing state-of-the-art solutions typically infer implicitly data association by iteratively reversing the event data generation process. However, the nonlinear nature of these methods limits their applicability in real-time tasks, and the constant-motion assumption leads to unstable results under agile motion. To this end, we rethink the problem formulation in a way that aligns better with the differential working principle of event cameras. We show that the event-based normal flow can be used, via the proposed geometric error term, as an alternative to the full flow in solving a family of geometric problems that involve instantaneous first-order kinematics and scene geometry. Furthermore, we develop a fast linear solver and a continuous-time nonlinear solver on top of the proposed geometric error term. Experiments on both synthetic and real data show the superiority of our linear solver in terms of accuracy and efficiency, and indicate its complementary feature as an initialization method for existing nonlinear solvers. Besides, our continuous-time non-linear solver exhibits exceptional capability in accommodating sudden variations in motion since it does not rely on the constant-motion assumption.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑