arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.06158cs.CV
收藏

0-MMS:单目事件摄像机Zero-Shot多运动分割

0-MMS: Zero-Shot Multi-Motion Segmentation With A Monocular Event Camera

University of Maryland, College Park(马里兰大学帕克分校)

Chethan M. Parameshwara, Nitin J. Sanket, Chahat Deep Singh, Cornelia Fermüller, Yiannis Aloimonos

摘要:

动态场景中运动目标的分割是导航任务中场景理解的一个关键过程。经典相机在这种情况下遭受运动模糊,从而使它们失效。相反,事件相机,因为它们的高时间分辨率和缺乏运动模糊,是为这个问题量身定制的。我们提出了一种单目多运动分割的方法,该方法将自下而上的特征跟踪和自上而下的运动补偿结合到一个统一的管道中,这是我们所知的第一种方法。该方法利用时间间隔内的事件,通过分割和合并将场景分割为多个运动。我们进一步加快我们的方法,通过使用运动传播和集群密钥片的概念。该方法在EV-IMO,EED和MOD数据集的具有挑战性的真实世界和合成场景中成功进行了评估,并超过了最先进的检测率12%,在上述数据集上实现了81.06%,94.2%和82.35%的最先进的平均检测率。为了进一步研究和系统评估多运动分割,我们提出并开源了一个名为MOD++的新数据集/基准,其中包括具有挑战性的序列和广泛的数据分层,包括相机和对象运动,速度大小,方向和旋转速度。

英文摘要:

Segmentation of moving objects in dynamic scenes is a key process in scene understanding for navigation tasks. Classical cameras suffer from motion blur in such scenarios rendering them effete. On the contrary, event cameras, because of their high temporal resolution and lack of motion blur, are tailor-made for this problem. We present an approach for monocular multi-motion segmentation, which combines bottom-up feature tracking and top-down motion compensation into a unified pipeline, which is the first of its kind to our knowledge. Using the events within a time-interval, our method segments the scene into multiple motions by splitting and merging. We further speed up our method by using the concept of motion propagation and cluster keyslices. The approach was successfully evaluated on both challenging real-world and synthetic scenarios from the EV-IMO, EED, and MOD datasets and outperformed the state-of-the-art detection rate by 12\%, achieving a new state-of-the-art average detection rate of 81.06%, 94.2% and 82.35% on the aforementioned datasets. To enable further research and systematic evaluation of multi-motion segmentation, we present and open-source a new dataset/benchmark called MOD++, which includes challenging sequences and extensive data stratification in-terms of camera and object motion, velocity magnitudes, direction, and rotational speeds.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑