通过观察学习:无人机巡逻的模仿学习,来自人类导航员的视频
Learn by Observation: Imitation Learning for Drone Patrolling from Videos of A Human Navigator
摘要:
提出了一种基于原始视频的无人机自主巡逻模仿学习方法。与以往的方法不同,我们提出让无人机通过观察和模仿人类导航员在地面上的操作来学习空中巡逻。观测过程使得能够使用帧间几何一致性自动收集和注释数据,从而减少手动工作量并提高准确性。然后,基于注释数据训练新设计的神经网络,以预测合适的方向和平移,使无人机像人类一样以车道保持方式巡逻。我们的方法允许无人机在高空飞行,视野开阔,风险低。它还可以检测十字路口的所有可访问方向,并进一步集成可用的用户指令和自主巡逻控制命令。通过大量的实验验证了所提出的模拟学习方法的正确性和无人机自主导航系统的可靠性。代码、数据集以及视频演示可在https://vsislab.github.io/uavpatrol上获得
英文摘要:
We present an imitation learning method for autonomous drone patrolling based only on raw videos. Different from previous methods, we propose to let the drone learn patrolling in the air by observing and imitating how a human navigator does it on the ground. The observation process enables the automatic collection and annotation of data using inter-frame geometric consistency, resulting in less manual effort and high accuracy. Then a newly designed neural network is trained based on the annotated data to predict appropriate directions and translations for the drone to patrol in a lane-keeping manner as humans. Our method allows the drone to fly at a high altitude with a broad view and low risk. It can also detect all accessible directions at crossroads and further carry out the integration of available user instructions and autonomous patrolling control commands. Extensive experiments are conducted to demonstrate the accuracy of the proposed imitating learning process as well as the reliability of the holistic system for autonomous drone navigation. The codes, datasets as well as video demonstrations are available at https://vsislab.github.io/uavpatrol
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。