arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.06987cs.ROcs.AI
收藏

基础世界模型准确检测双臂机械臂故障

Foundational World Models Accurately Detect Bimanual Manipulator Failures

Stanford University(斯坦福大学);Watney Robotics(Watney机器人公司)

Isaac R. Ward, Michelle Ho, Houjun Liu, Aaron Feldman, Joseph Vincent, Liam Kruse, Sean Cheong, Duncan Eddy, Mykel J. Kochenderfer, Mac Schwager

AI总结:

本文提出基于视觉基础模型的双臂机械臂故障检测方法,通过压缩潜在空间中的世界模型提升检测精度,相比传统方法在参数效率和故障检测率上均表现更优。

摘要:

在大规模部署视觉-运动机器人时,由于异常故障可能导致性能下降、造成损坏或危及人类生命,因此具有挑战性。双臂机械臂也不例外;这些机器人包含大量状态空间,由高维图像和本体感觉信号组成。在这样的状态空间中显式定义故障模式是不可行的。在本工作中,我们通过在预训练的视觉基础模型(NVIDIA的Cosmos Tokenizer)的压缩潜在空间中训练一个概率性、基于历史的世界模型,来克服这些挑战。该模型输出不确定性估计以及预测,这些估计在符合预测框架中作为非一致性评分。我们利用这些评分开发了一个运行时监控器,将高不确定性时期与异常故障相关联。为了测试这些方法,我们使用模拟的Push-T环境和双臂电缆操纵数据集,后者是我们在此工作中引入的。这个新数据集包含具有多个同步摄像机视角、本体感觉信号和标注故障的轨迹,来自具有挑战性的数据中心维护任务。我们将我们的方法与异常检测和分布外检测文献中的基线方法进行了比较,并证明我们的方法显著优于统计技术。此外,我们还证明,我们的方法在可训练参数方面大约只需要下一最佳基于学习的方法的二十分之一,但在故障检测率方面比其高出3.8%,为在可靠性不可妥协的真实环境中安全部署机械臂机器人铺平了道路。

英文摘要:

Deploying visuomotor robots at scale is challenging due to the potential for anomalous failures to degrade performance, cause damage, or endanger human life. Bimanual manipulators are no exception; these robots have vast state spaces comprised of high-dimensional images and proprioceptive signals. Explicitly defining failure modes within such state spaces is infeasible. In this work, we overcome these challenges by training a probabilistic, history informed, world model within the compressed latent space of a pretrained vision foundation model (NVIDIA's Cosmos Tokenizer). The model outputs uncertainty estimates alongside its predictions that serve as non-conformity scores within a conformal prediction framework. We use these scores to develop a runtime monitor, correlating periods of high uncertainty with anomalous failures. To test these methods, we use the simulated Push-T environment and the Bimanual Cable Manipulation dataset, the latter of which we introduce in this work. This new dataset features trajectories with multiple synchronized camera views, proprioceptive signals, and annotated failures from a challenging data center maintenance task. We benchmark our methods against baselines from the anomaly detection and out-of-distribution detection literature, and show that our approach considerably outperforms statistical techniques. Furthermore, we show that our approach requires approximately one twentieth of the trainable parameters as the next-best learning-based approach, yet outperforms it by 3.8% in terms of failure detection rate, paving the way toward safely deploying manipulator robots in real-world environments where reliability is non-negotiable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑