视觉-力导纳学习用于可移动孔洞的插销任务
Vision-Force Admittance Learning for Peg Insertion into a Movable Hole
- New York University(纽约大学)
- General Motors(通用汽车公司)
机构由 AI 辅助整理,请以论文原文为准。
AI总结:
针对动态环境下插销入孔精度难题,提出视觉-力导纳学习框架,融合异步视觉与高频力模型,实现毫米级精度在线调整,实验验证高成功率与强适应性。
AI中文摘要:
在动态环境中的精确操作,无论是由于移动机器人基座还是具有未知运动的目标引起的,仍然是机器人学中的一项重大挑战。动态环境中的操作引入了显著的不确定性,这与插销入孔等精确任务的严格精度要求从根本上相冲突。我们提出了一种视觉-力导纳学习(VFAL)框架,该框架将异步视觉反馈与高频基于力的模型相融合,使用视觉位姿估计作为正则化项。VFAL在线调整插入策略以适应动态运动,同时保持毫米级精度。为了获得鲁棒的、低频的位姿信息,我们采用了最先进的视觉基础模型进行视觉位姿估计。此外,我们加入了故障恢复机制以增强整体鲁棒性。我们在真实世界实验中验证了我们的方法,展示了高成功率以及对各种销钉和动态环境的强适应性。
英文摘要:
Precise manipulation in dynamic environments, whether induced by a mobile robot base or a target with unknown motion, remains a major challenge in robotics. Manipulation in dynamic environments introduces substantial uncertainty, which fundamentally conflicts with the tight precision requirement of precise tasks such as peg-in-the-hole. We propose a Vision-Force Admittance Learning (VFAL) framework that fuses asynchronous visual feedback with a high-frequency force-based model, using visual pose estimations as a regularization term. VFAL adapts insertion strategies online to dynamic motion while maintaining millimeter-level precision. To obtain robust, low-frequency pose information, we employ state-of-the-art vision foundation models for visual pose estimation. Additionally, we incorporate failure recovery mechanisms to enhance overall robustness. We validate our approach in real-world experiments, demonstrating high success rates and strong adaptability to various pegs and dynamic environments.