arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.05903cs.RO
收藏

FAST-Dynamic-Vision:使用事件和深度传感检测和跟踪动态对象

FAST-Dynamic-Vision: Detection and Tracking Dynamic Objects with Event and Depth Sensing

Zhejiang University(浙江大学);Huzhou Institute of Zhejiang University(浙江大学湖州研究院);Nanjing Institute of Technology(南京工程学院);Northeastern University(东北大学)

Botao He, Haojia Li, Siyuan Wu, Dong Wang, Zhiwei Zhang, Qianli Dong, Chao Xu, Fei Gao

摘要:

航空自主化的发展使航空机器人能够在复杂环境中灵活飞行。然而,在飞行中躲避快速移动的物体仍然是一个挑战,限制了无人机(UAV)的进一步应用。解决这一问题的瓶颈是对快速动态对象的准确感知。最近,事件摄像机在解决这个问题方面显示出巨大的潜力。本文提出了一个完整的感知系统,包括自我运动补偿,目标检测,快速移动的动态对象的低延迟和高精度的轨迹预测。首先,我们提出了一个精确的自我运动补偿算法,同时考虑旋转和平移运动的更强大的目标检测。然后,针对动态目标检测,设计了一种基于事件相机的高效回归算法。最后,我们提出了一种基于优化的方法,异步融合事件和深度相机的轨迹预测。广泛的现实世界的实验和基准进行验证我们的框架。此外,我们的代码将发布,以利于相关研究。

英文摘要:

The development of aerial autonomy has enabled aerial robots to fly agilely in complex environments. However, dodging fast-moving objects in flight remains a challenge, limiting the further application of unmanned aerial vehicles (UAVs). The bottleneck of solving this problem is the accurate perception of rapid dynamic objects. Recently, event cameras have shown great potential in solving this problem. This paper presents a complete perception system including ego-motion compensation, object detection, and trajectory prediction for fast-moving dynamic objects with low latency and high precision. Firstly, we propose an accurate ego-motion compensation algorithm by considering both rotational and translational motion for more robust object detection. Then, for dynamic object detection, an event camera-based efficient regression algorithm is designed. Finally, we propose an optimizationbased approach that asynchronously fuses event and depth cameras for trajectory prediction. Extensive real-world experiments and benchmarks are performed to validate our framework. Moreover, our code will be released to benefit related researches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑