arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09845cs.RO
收藏

基于视觉语言模型与强化学习的轮腿机器人摩擦感知安全运动控制

Friction-Aware Safety Locomotion for Wheeled-legged Robots using Vision Language Models and Reinforcement Learning

University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Department of Electrical and Computer Engineering(电气与计算机工程系);Department of Mechanical Science Engineering(机械科学与工程系);School of Software(软件学院)

Bo Peng, Donghoon Baek, Qijie Wang, Joao Ramos

AI总结:

针对轮腿机器人在湿滑表面易打滑失稳的问题,提出融合VLM与RL的摩擦感知安全运动框架,通过RAG估计摩擦系数并纳入策略实现主动调速,仿真与实物实验验证其在湿滑面轨迹跟踪任务中优于仅靠本体感受的基线方法。

摘要:

轮腿机器人因依赖持续地面接触,在湿滑表面上的控制极具挑战性。与可借助多个固定接触点恢复姿态的四足或双足机器人不同,轮腿机器人极易发生打滑,即便短暂失去牵引力也可能导致无法恢复的失稳。在接触前预判摩擦等地面物理属性,可实现主动控制调整以降低打滑风险。本文提出一种融合视觉语言模型(VLM)与强化学习(RL)策略的摩擦感知安全运动框架。该方法采用检索增强生成(RAG)方法估计摩擦系数(CoF),并将其显式纳入RL策略,使机器人能在接触前根据预测的摩擦状况调整速度。该框架在仿真环境和定制化实物轮式倒立摆(WIP)上均通过实验验证。实验结果表明,本文方法能在湿滑表面上成功完成轨迹跟踪任务,而仅依赖本体感受反馈的基线方法则失败。这些发现凸显了显式预测并利用地面摩擦信息对安全运动的重要性与有效性,也为探索利用VLM估计地面状况这一纯视觉方法仍面临的重大挑战,指明了颇具前景的研究方向。

英文摘要:

Controlling Wheeled-legged robots is challenging especially on slippery surfaces due to their dependence on continuous ground contact. Unlike quadrupeds or bipeds, which can leverage multiple fixed contact points for recovery, wheeled-legged robots are highly susceptible to slip, where even momentary loss of traction can result in irrecoverable instability. Anticipating ground physical properties such as friction before contact would allow proactive control adjustments, reducing slip risk. In this paper, we propose a friction-aware safety locomotion framework that integrates Vision-Language Models (VLMs) with a Reinforcement Learning (RL) policy. Our method employs a Retrieval-Augmented Generation (RAG) approach to estimate the Coefficient of Friction (CoF), which is then explicitly incorporated into the RL policy. This enables the robot to adapt its speed based on predicted friction conditions before contact. The framework is validated through experiments in both simulation and on a physical customized Wheeled Inverted Pendulum (WIP). Experimental results show that our approach successfully completes trajectory tracking tasks on slippery surfaces, whereas baseline methods relying solely on proprioceptive feedback fail. These findings highlight the importance and effectiveness of explicitly predicting and utilizing ground friction information for safe locomotion. They also point to a promising research direction in exploring the use of VLMs for estimating ground conditions, which remains a significant challenge for purely vision-based methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑