arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.21130cs.RO
收藏

自预测表征用于自主无人机目标-目标导航

Self-Predictive Representation for Autonomous UAV Object-Goal Navigation

Escola Politécnica de Pernambuco, Universidade de Pernambuco(巴伊兰联邦大学皮奥伊技术学院);School of Computer Science and Engineering, University of New South Wales(新南威尔士大学计算机科学与工程学院);School of Mechanical and Manufacturing Engineering, University of New South Wales(新南威尔士大学机械与制造工程学院);Escuela de Ingeniería, Universidad Central de Chile(智利中央大学工程学院)

Angel Ayala, Donling Sui, Francisco Cruz, Mitchell Torok, Mohammad Deghat, Bruno J. T. Fernandes

AI总结:

本文提出自预测模型AmelPred,用于提升无人机在3D目标-目标导航中的数据样本效率和规划性能。

摘要:

自主无人机(UAV)通过其多功能性已革新了多个行业,包括空中监视、搜救、农业和配送。其自主能力在大型开放空间环境中具有独特优势。强化学习(RL)使无人机能够学习复杂的导航策略,从而自主优化飞行行为。然而,其主要挑战之一是使用数据样本效率低。在目标-目标导航(OGN)设置中,目标识别成为额外挑战。大多数无人机相关方法使用相对或绝对坐标从初始位置移动到预定位置,而不是直接寻找目标。本研究旨在解决解决3D OGN问题中的数据样本效率问题,同时将未知目标位置设置形式化为马尔可夫决策过程。实验分析了不同状态表征学习(SRL)方法与无模型RL算法在自主导航系统中的交互。本文的主要贡献是开发了感知模块,其中包含一种名为AmelPred的新型自预测模型。实验证明,其随机版本AmelPredSto在与actor-critic RL算法结合时是最佳的SRL模型。获得的结果表明,使用AmelPredSto在解决OGN问题中显著提高了RL算法的效率。

英文摘要:

Autonomous Unmanned Aerial Vehicles (UAVs) have revolutionized industries through their versatility with applications including aerial surveillance, search and rescue, agriculture, and delivery. Their autonomous capabilities offer unique advantages, such as operating in large open space environments. Reinforcement Learning (RL) empowers UAVs to learn intricate navigation policies, enabling them to optimize flight behavior autonomously. However, one of its main challenge is the inefficiency in using data sample to achieve a good policy. In object-goal navigation (OGN) settings, target recognition arises as an extra challenge. Most UAV-related approaches use relative or absolute coordinates to move from an initial position to a predefined location, rather than to find the target directly. This study addresses the data sample efficiency issue in solving a 3D OGN problem, in addition to, the formalization of the unknown target location setting as a Markov decision process. Experiments are conducted to analyze the interplay of different state representation learning (SRL) methods for perception with a model-free RL algorithm for planning in an autonomous navigation system. The main contribution of this study is the development of the perception module, featuring a novel self-predictive model named AmelPred. Empirical results demonstrate that its stochastic version, AmelPredSto, is the best-performing SRL model when combined with actor-critic RL algorithms. The obtained results show substantial improvement in RL algorithms' efficiency by using AmelPredSto in solving the OGN problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑