arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.08263cs.RO
收藏

一种用于缩小自主水面车辆(ASV)导航中仿真到现实差距的深度强化学习框架与方法

A Deep Reinforcement Learning Framework and Methodology for Reducing the Sim-to-Real Gap in ASV Navigation

Georgia Institute of Technology(佐治亚理工学院);GeorgiaTech Europe - IRL2958 GT-CNRS(佐治亚理工欧洲分部 - IRL2958 中法联合实验室);University of Luxembourg(卢森堡大学)

Luis F W Batista, Junghwan Ro, Antoine Richard, Pete Schroepfer, Seth Hutchinson, Cedric Pradalier

AI总结:

针对深度强化学习在自主水面车辆(ASV)实际部署受限的问题,提出集成浮力与流体动力学模型、结合系统辨识和域随机化的强化学习方法,缩小仿真到现实差距,降低能耗并缩短任务时间,开源实现助力ASV效率提升与环保应用。

摘要:

尽管深度强化学习(DRL)在自主水面车辆(ASV)中的应用日益广泛,但仍存在一些限制其实际部署的挑战。本文首先将浮力和流体动力学模型集成到一个现代强化学习框架中,以缩短训练时间。接着,本文展示了系统辨识结合域随机化如何提升强化学习智能体的性能并缩小仿真到现实的差距。针对漂浮垃圾打捞任务的真实世界实验表明,该方法降低了13.1%的能耗,同时将任务完成时间缩短了7.4%。这些发现(随附我们的开源实现)有望提升ASV的效率和通用性,为环境保护工作做出贡献。

英文摘要:

Despite the increasing adoption of Deep Reinforcement Learning (DRL) for Autonomous Surface Vehicles (ASVs), there still remain challenges limiting real-world deployment. In this paper, we first integrate buoyancy and hydrodynamics models into a modern Reinforcement Learning framework to reduce training time. Next, we show how system identification coupled with domain randomization improves the RL agent performance and narrows the sim-to-real gap. Real-world experiments for the task of capturing floating waste show that our approach lowers energy consumption by 13.1\% while reducing task completion time by 7.4\%. These findings, supported by sharing our open-source implementation, hold the potential to impact the efficiency and versatility of ASVs, contributing to environmental conservation efforts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑