arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2604.07395cs.ROcs.AIcs.CV

一种物理代理循环用于语言引导的抓取与执行状态监控

A Physical Agentic Loop for Language-Guided Grasping with Execution-State Monitoring

Australian Institute for Machine Learning (AIML), Adelaide University(澳大利亚阿德莱德大学澳大利亚机器学习研究所)

Wenze Wang, Mehdi Hosseinzadeh, Feras Dayoub

AI总结:

本文提出一种物理代理循环,通过事件接口和执行监控层提升语言引导抓取的鲁棒性和可解释性,验证了其在视觉模糊和执行失败场景中的有效性。

摘要:

本文提出了一种物理代理循环,通过事件接口和执行监控层提升语言引导抓取的鲁棒性和可解释性,验证了其在视觉模糊和执行失败场景中的有效性。

英文摘要:

Robotic manipulation systems that follow language instructions often execute grasp primitives in a largely single-shot manner: a model proposes an action, the robot executes it, and failures such as empty grasps, slips, stalls, timeouts, or semantically wrong grasps are not surfaced to the decision layer in a structured way. Inspired by agentic loops in digital tool-using agents, we reformulate language-guided grasping as a bounded embodied agent operating over grounded execution states, where physical actions expose an explicit tool-state stream. We introduce a physical agentic loop that wraps an unmodified learned manipulation primitive (grasp-and-lift) with (i) an event-based interface and (ii) an execution monitoring layer, Watchdog, which converts noisy gripper telemetry into discrete outcome labels using contact-aware fusion and temporal stabilization. These outcome events, optionally combined with post-grasp semantic verification, are consumed by a deterministic bounded policy that finalizes, retries, or escalates to the user for clarification, guaranteeing finite termination. We validate the resulting loop on a mobile manipulator with an eye-in-hand D405 camera, keeping the underlying grasp model unchanged and evaluating representative scenarios involving visual ambiguity, distractors, and induced execution failures. Results show that explicit execution-state monitoring and bounded recovery enable more robust and interpretable behavior than open-loop execution, while adding minimal architectural overhead. For the source code and demo refer to our project page: https://wenzewwz123.github.io/Agentic-Loop/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑