arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.11751cs.RO
收藏

越野自主车辆多模态动力学建模

Multimodal dynamics modeling for off-road autonomous vehicles

McGill University(麦吉尔大学)

Jean-François Tremblay, Travis Manderson, Aurélio Noca, Gregory Dudek, David Meger

摘要:

户外和非结构化环境中的动力学建模是困难的,因为环境中的不同元素与机器人的交互方式可能难以预测。因此,在构建模型以执行关于机器人动态的预测并以进行运动规划为目标时,利用多个传感器来感知关于机器人环境的最大信息至关重要。我们设计了一个能够进行长时间运动预测的模型,利用视觉,激光雷达和本体感受,这对测试时任意丢失的模态是鲁棒的。我们在模拟中证明,我们的模型能够利用视觉来预测牵引力的变化。然后,我们使用一个具有挑战性的真实数据集来测试我们的模型,该数据集是一个机器人在森林中导航,在训练过程中看不到的轨迹中进行预测。我们在测试时尝试不同的模态组合,并表明,虽然我们的模型在所有模态都存在时表现最好,但即使只接收原始视觉输入而没有本体感觉,以及只接收本体感觉时,它仍然能够比基线表现得更好。总的来说,我们的研究证明了在户外条件下进行动力学建模时利用多个传感器的重要性。

英文摘要:

Dynamics modeling in outdoor and unstructured environments is difficult because different elements in the environment interact with the robot in ways that can be hard to predict. Leveraging multiple sensors to perceive maximal information about the robot's environment is thus crucial when building a model to perform predictions about the robot's dynamics with the goal of doing motion planning. We design a model capable of long-horizon motion predictions, leveraging vision, lidar and proprioception, which is robust to arbitrarily missing modalities at test time. We demonstrate in simulation that our model is able to leverage vision to predict traction changes. We then test our model using a real-world challenging dataset of a robot navigating through a forest, performing predictions in trajectories unseen during training. We try different modality combinations at test time and show that, while our model performs best when all modalities are present, it is still able to perform better than the baseline even when receiving only raw vision input and no proprioception, as well as when only receiving proprioception. Overall, our study demonstrates the importance of leveraging multiple sensors when doing dynamics modeling in outdoor conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑