arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.07378cs.SE
收藏

GARL:遗传算法增强的强化学习用于检测基于标记的自主着陆系统中的违规行为

GARL: Genetic Algorithm-Augmented Reinforcement Learning to Detect Violations in Marker-Based Autonomous Landing Systems

Linfeng Liang, Yao Deng, Kye Morton, Valtteri Kallinen, Alice James, Avishkar Seth, Endrowednes Kuantama, Subhas Mukhopadhyay, Richard Han, Xi Zheng

AI总结:

GARL 框架结合遗传算法与强化学习,在有限预算内高效生成多样且真实的自主 UAV 着陆失败案例,违规率最高提升 18.35%,多样性提升 58%,并首次融合离线和在线测试策略。

摘要:

自动化无人驾驶飞行器(UAV)着陆对于监测、勘测和包裹投递等自主 UAV 服务至关重要。它涉及检测着陆目标、感知障碍物、规划无碰撞路径以及控制 UAV 运动以实现安全着陆。失败可能导致重大损失,因此需要通过基于仿真的严格测试来保障安全。传统的离线测试方法仅限于静态环境和预定义轨迹,可能遗漏由人和动物等动态物体引起的违规案例。相反,在线测试方法需要大量训练时间,在预算有限的情况下不切实际。为解决这些问题,我们提出了 GARL,一个结合遗传算法(GA)和强化学习(RL)的框架,用于在实际预算内高效生成多样且真实的着陆系统失败案例。GARL 使用 GA 在离线阶段探索各种环境设置,降低 RL 在模拟具有挑战性的着陆场景时进行在线测试的复杂性。我们的方法在违规率上比现有方法高出最多 18.35%,在多样性指标上高出 58%。我们通过真实世界 UAV 测试验证了大多数发现的违规类型,开创性地将离线和在线测试策略集成用于自主系统。该方法为在线测试开辟了新的研究方向,我们的代码和补充材料可在 https://github.com/lfeng0722/drone_testing/ 获取。

英文摘要:

Automated Uncrewed Aerial Vehicle (UAV) landing is crucial for autonomous UAV services such as monitoring, surveying, and package delivery. It involves detecting landing targets, perceiving obstacles, planning collision-free paths, and controlling UAV movements for safe landing. Failures can lead to significant losses, necessitating rigorous simulation-based testing for safety. Traditional offline testing methods, limited to static environments and predefined trajectories, may miss violation cases caused by dynamic objects like people and animals. Conversely, online testing methods require extensive training time, which is impractical with limited budgets. To address these issues, we introduce GARL, a framework combining a genetic algorithm (GA) and reinforcement learning (RL) for efficient generation of diverse and real landing system failures within a practical budget. GARL employs GA for exploring various environment setups offline, reducing the complexity of RL's online testing in simulating challenging landing scenarios. Our approach outperforms existing methods by up to 18.35% in violation rate and 58% in diversity metric. We validate most discovered violation types with real-world UAV tests, pioneering the integration of offline and online testing strategies for autonomous systems. This method opens new research directions for online testing, with our code and supplementary material available at https://github.com/lfeng0722/drone_testing/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑