arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.07866cs.ROcs.LGcs.SYeess.SY

用于现场检查和维护中移动操作的部分观察下语言引导抓取

Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance

Department of Mechanical Engineering, Federal University of Uberlândia(联邦大学伯南迪利亚机械工程系);Department of Mechanical Engineering, University of São Paulo(圣保罗大学机械工程系);Graduate School of Information Sciences, Tohoku University(东北大学信息科学研究生院);Faculdade Israelita de Ensino e Pesquisa Albert Einstein, Hospital Israelita Albert Einstein(艾伯特·爱因斯坦以色列教学与研究学院,艾伯特·爱因斯坦医院)

Dilermando Almeida, Juliano Negri, Guilherme Lazzarini, Thiago H. Segreto, Ranulfo Bezerra, Gustavo J. G. Lahr, Ricardo V. Godoy, Marcelo Becker

AI总结:

提出用于腿部移动操纵器在部分观察下的语言引导抓取流程,经多步骤处理,在四足机器人上实现并评估,相比基线提高抓取成功率,提升语言引导抓取可靠性。

摘要:

海上检查和维护越来越多地使用腿部机器人进行常规传感,但许多干预仍需与工具等物理交互。本文提出用于腿部移动操纵器在部分观察下操作的语言引导抓取管道,经多步骤处理并在四足机器人上评估,提升了抓取成功率和可靠性。

英文摘要:

Offshore inspection and maintenance have increasingly been using legged robots for routine sensing, yet many useful interventions still require physical interaction with tools, containers, and task-relevant objects. Employing robots for these tasks can reduce operators' exposure in confined, elevated, or potentially explosive areas. This paper presents a language-guided grasping pipeline for a legged mobile manipulator operating under partial observation. An operator defines the target, the system grounds it in RGB with open-vocabulary detection and promptable segmentation, extracts an object-centric RGB-D point cloud, improves sparse geometry through depth compensation and point-cloud completion, and selects a 6-DoF grasp using collision, clearance, reachability, and approach constraints. The system is implemented on a quadruped robot with an arm and evaluated in two cluttered tabletop scenes motivated by small-object retrieval during inspection and maintenance. Across paired trials, the proposed pipeline achieved 9/10 successful grasps, compared with 3/10 for a view-dependent deployment baseline. In this controlled setting, object-centric completion and execution-aware selection reduced approach collisions and improved the reliability of language-guided grasping for supervised field manipulation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑