arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2605.01289cs.RO
收藏

双层强化学习控制用于通过质心重构的欠驱动飞艇

Bi-Level Reinforcement Learning Control for an Underactuated Blimp via Center-of-Mass Reconfiguration

Xiaorui Wang, Hongwu Wang, Yue Fan, Hao Cheng, Feitian Zhang

AI总结:

本文研究了通过质心重构实现目标导向跟踪控制的欠驱动飞艇,提出双层强化学习框架以分离任务级质心规划与连续推力控制,通过仿真和实验验证方法的有效性。

摘要:

本文研究了目标导向跟踪控制的欠驱动飞艇,通过质心重构。与传统过驱动飞艇设计不同,本文采用紧凑结构,包含两个推力器和可移动内部滑块,旨在提高能效和载荷能力。该硬件高效配置引入了显著欠驱动和强非线性耦合。为此,本文提出双层强化学习框架,显式解耦任务级质心规划与连续推力控制。外层策略在飞行前确定目标依赖的质心配置,内层策略生成推力指令以跟踪直线参考。为确保稳定学习,本文引入两阶段学习策略,支持由此产生的双层过程的收敛分析。广泛仿真和真实世界实验在27个目标评估集上显示,所提方法在跟踪精度、鲁棒性和仿真到现实转移方面均优于固定质心基线和PID控制器。

英文摘要:

This paper investigates goal-directed tracking control of underactuated blimps with center-of-mass (CoM) reconfiguration. Unlike conventional overactuated blimp designs that rely on redundant actuation for simplified control, this paper focuses on a compact architecture consisting of two thrusters and a movable internal slider, aiming to improve energy efficiency and payload capacity. This hardware-efficient configuration introduces significant underactuation and strong nonlinear coupling between CoM dynamics and vehicle motion. To address these challenges, this paper proposes a bi-level reinforcement learning framework that explicitly decouples task-level CoM planning from continuous thrust control. The outer policy determines a target-dependent CoM configuration prior to flight, while the inner policy generates thrust commands to track straight-line references. To ensure stable learning, this paper introduces a two-stage learning strategy, supported by a convergence analysis of the resulting bi-level process. Extensive simulations and real-world experiments on a 27-goal evaluation set demonstrate that the proposed method consistently outperforms fixed-CoM baselines and PID-based controllers, achieving higher tracking accuracy, enhanced robustness, and reliable sim-to-real transfer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑