感知行为基础模型:将人体运动先验适应到以机器人为中心的地形
Perceptive Behavior Foundation Model: Adapting Human Motion Priors to Robot-Centric Terrain
AI总结:
提出感知行为基础模型(Perceptive BFM),通过地形一致参考合成(TCRS)将人体运动先验适应到机器人局部地形,实现地形感知的人形机器人控制。
摘要:
人形机器人行为基础模型旨在从广泛的人体运动先验中获取可复用的全身控制策略,使单一控制器能够产生多样且富有表现力的行为。然而,现有的以运动为中心的基础策略大多假设参考运动已经与机器人周围环境物理兼容。当演示者、操作者和机器人处于不同环境时,这一假设不再成立:人体运动可能指定了预期行为,但并未指定机器人局部地形所需的落脚点、间隙、身体高度或接触时机。我们引入了\emph{感知行为基础模型}(Perceptive BFM),这是一种地形感知的人形机器人控制框架,将人体运动先验植根于以机器人为中心的感知。该模型保留原始运动学运动参考作为行为接口,同时利用局部地形观测来调整接触、姿态和时机。为了提供可扩展的地形监督,我们开发了\emph{地形一致参考合成}(TCRS),通过接触感知的落脚点构建、足部几何感知的摆动优化、支撑感知的根部重建、碰撞修复和多点逆运动学,将面向运动的运动片段转换为地形一致的参考。然后,我们训练一个盲适应参考教师,并通过目标帧动作对齐将其地形一致行为迁移到部署的原始参考学生。学生是一个身份门控Transformer跟踪器,其地形特征通过残差路径进入,这些路径初始化为保留运动跟踪先验,并仅在需要时训练产生局部修正。
英文摘要:
Humanoid behavior foundation models aim to acquire reusable whole-body control policies from broad human motion priors, enabling a single controller to produce diverse and expressive behaviors. However, existing motion-centric foundation policies largely assume that the reference motion is already physically compatible with the robot's surroundings. This assumption breaks when the demonstrator, operator, and robot inhabit different environments: a human motion may specify the intended behavior, but not the footholds, clearance, body height, or contact timing required by the robot's local terrain. We introduce \emph{Perceptive Behavior Foundation Model} (Perceptive BFM), a terrain-aware humanoid control framework that grounds human motion priors in robot-centric perception. The model preserves raw kinematic motion references as the behavioral interface, while using local terrain observations to adapt contacts, posture, and timing. To provide scalable terrain supervision, we develop \emph{terrain-conformal reference synthesis} (TCRS), which converts locomotion-oriented human motion clips into terrain-consistent references through contact-aware foothold construction, foot-geometry-aware swing optimization, support-aware root reconstruction, collision repair, and multi-point inverse kinematics. We then train a blind adapted-reference teacher and transfer its terrain-conformal behavior to a deployed raw-reference student through target-frame action alignment. The student is an identity-gated Transformer tracker whose terrain features enter through residual pathways initialized to preserve the motion-tracking prior and trained to produce local corrections only when needed.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。