arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.01751cs.ROcs.AIcs.LGcs.SYeess.SY
收藏

具有形状可解释性的视觉自建模使几何感知的连续体机器人控制成为可能

Shape-Interpretable Visual Self-Modeling Enables Geometry-Aware Continuum Robot Control

School of Computer Science and Engineering, Sun Yat-sen University(计算机科学与工程学院,中山大学)

Peng Yu, Xin Wang, Ning Tan

AI总结:

本文提出一种基于形状可解释性的视觉自建模框架,通过贝塞尔曲线表示法实现连续体机器人几何感知的控制,实验验证了其在复杂环境中的鲁棒性和精度。

摘要:

连续体机器人具有高灵活性和冗余性,使其在复杂环境中安全交互非常合适,但其连续变形和非线性动力学对感知、建模和控制构成了根本性挑战。现有的基于视觉的控制方法通常依赖端到端学习,通过形状调节实现控制,但缺乏对机器人几何结构及其与环境交互的显式意识。本文介绍了一种针对连续体机器人的形状可解释性视觉自建模框架,实现了几何感知的控制。通过多视角平面图像对机器人形状进行编码,使用贝塞尔曲线表示法将其转换为紧凑且具有物理意义的形状空间,该空间能够唯一地表征机器人三维配置。基于此表示,神经普通微分方程被用于从数据中直接自建模形状和末端执行器动力学,实现混合形状-位置控制,而无需分析模型或密集体标记。所学习的显式几何结构使机器人能够推断其身体和周围环境,支持环境感知行为,如避障和自主运动,同时保持末端执行器目标。在电缆驱动的连续体机器人上的实验展示了准确的形状-位置调节和跟踪,形状误差在图像分辨率的1.56%以内,末端执行器误差在机器人长度的2%以内,且在受限环境中表现出鲁棒性。通过将二维观测的视觉形状表示提升到可解释的三维自建模,这项工作建立了一种基于视觉的端到端控制的原理性替代方案,并推动了连续体机器人的自主、几何感知操作。

英文摘要:

Continuum robots possess high flexibility and redundancy, making them well suited for safe interaction in complex environments, yet their continuous deformation and nonlinear dynamics pose fundamental challenges to perception, modeling, and control. Existing vision-based control approaches often rely on end-to-end learning, achieving shape regulation without explicit awareness of robot geometry or its interaction with the environment. Here, we introduce a shape-interpretable visual self-modeling framework for continuum robots that enables geometry-aware control. Robot shapes are encoded from multi-view planar images using a Bezier-curve representation, transforming visual observations into a compact and physically meaningful shape space that uniquely characterizes the robot's three-dimensional configuration. Based on this representation, neural ordinary differential equations are employed to self-model both shape and end-effector dynamics directly from data, enabling hybrid shape-position control without analytical models or dense body markers. The explicit geometric structure of the learned shape space allows the robot to reason about its body and surroundings, supporting environment-aware behaviors such as obstacle avoidance and self-motion while maintaining end-effector objectives. Experiments on a cable-driven continuum robot demonstrate accurate shape-position regulation and tracking, with shape errors within 1.56% of image resolution and end-effector errors within 2% of robot length, as well as robust performance in constrained environments. By elevating visual shape representations from two-dimensional observations to an interpretable three-dimensional self-model, this work establishes a principled alternative to vision-based end-to-end control and advances autonomous, geometry-aware manipulation for continuum robots.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑