arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.15486cs.RO
收藏

面向月球表面作业的安全约束全身 locomotion-manipulation 学习

Learning Safety-Constrained Whole-Body Loco-Manipulation for Lunar Surface Operations

Alvaro Belmonte-Baeza, Miguel Cazorla, Gabriel J. García, Carlos J. Pérez-Del-Pulgar, Jorge Pomares

AI总结:

本文提出面向四足移动机械臂的约束强化学习框架,学习单一全身策略跟踪6维末端执行器位姿,在月球模拟环境中验证,可减少软约束违反时间且无硬约束违反。

摘要:

用于月球表面作业的机器人系统必须自主行动,且在故障不可恢复、无法持续监督的环境中保持自身完整性。本文提出一种面向四足移动机械臂的 Constrained Reinforcement Learning(约束强化学习)框架,该框架学习单一全身策略以跟踪任务空间中指定的6维末端执行器位姿,学习过程中通过约束学习机制强制执行操作极限。我们引入一种奖励公式,其中 locomotion( locomotion 即移动)与 manipulation(操作)之间的转换源于奖励几何而非显式门控机制;还引入一项稳定性项,该稳定性项源自 Gravito-Inertial Inclination Margin(重力惯性倾斜裕度),并受月球表面的低重力动力学驱动;此外,还提出一项奖励正则化设计规则,该规则源于基于终止的目标的乘法结构。该框架在月球模拟环境中进行评估,涵盖三种地形形态、五个难度等级,采用月球重力,月壤接触特性校准为 JSC-1a 模拟物,且在疏松至致密范围内变化。学习到的策略在标称条件下达到平均位置误差3.22厘米、方向误差6.83度,在不同月壤密度和具有操作代表性的地形难度范围内保持该精度,与无约束基线相比,软约束违反时间减少多达一个数量级,且未出现硬约束违反。

英文摘要:

Robotic systems for lunar surface operations must act autonomously and preserve their own integrity in an environment where failures are unrecoverable and continuous supervision is impossible. This paper presents a Constrained Reinforcement Learning framework for quadrupedal mobile manipulators that learns a single whole-body policy for tracking a 6D end-effector pose specified in task space, with operational limits enforced during learning through a constrained learning mechanism. We introduce a reward formulation in which the transition between locomotion and manipulation emerges from the reward geometry rather than from an explicit gating mechanism, a stability term derived from the Gravito-Inertial Inclination Margin and motivated by the reduced-gravity dynamics of the lunar surface, and a design rule for reward regularization that follows from the multiplicative structure of the termination-based objective. The framework is evaluated in a lunar-analog simulation spanning three terrain morphologies at five difficulty levels under lunar gravity, with regolith contact properties calibrated to the JSC-1a simulant and varied from loose to dense. The learned policy attains mean position and orientation errors of 3.22 cm and 6.83 deg. under nominal conditions, retains this precision across regolith densities and over the operationally representative range of terrain difficulty, and reduces soft-constraint violation time by up to an order of magnitude relative to an unconstrained baseline while incurring no hard-constraint violations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑