arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.07541cs.RO

区分与注入:通过参数结构推理诱导的功能区分来增强VLAs

Differentiate-and-Inject: Enhancing VLAs via Functional Differentiation Induced by In-Parameter Structural Reasoning

University of Science(科学大学);Zhejiang University of Technology(浙江工业大学);Technology University(技术大学)

Jingyi Hou, Leyu Zhou, Chenchen Jing, Jinghan Yang, Xinbo Yu, Wei He

AI总结:

iSTAR通过参数结构推理诱导功能区分,提升VLA模型在任务分解和任务变化下的可靠性与成功率。

摘要:

随着机器人被期望执行越来越多样化的任务,它们必须不仅理解低层次的动作,还要理解决定任务如何展开的高层次结构。现有的视觉-语言-动作(VLA)模型在这一形式的任务级推理上存在困难。它们要么依赖于基于提示的上下文分解,这种做法不稳定且对语言变化敏感,要么采用端到端的长周期训练,这需要大规模的示范数据,并将任务级推理与低层次控制纠缠在一起。我们提出了在参数结构中进行任务推理(iSTAR),一种通过参数结构推理诱导的功能区分来增强VLA模型的框架。不同于将VLA视为单一策略,iSTAR将任务级语义结构直接嵌入到模型参数中,使任务级推理能够无需外部规划器或手工提示输入即可实现差异化。这种注入的结构以隐式动态场景图知识的形式呈现,能够在参数空间中捕捉物体关系、子任务语义和任务级依赖关系。在多样化的操作基准测试中,iSTAR在任务分解的可靠性以及成功率达到比基于上下文和端到端VLA基线更高,证明了参数空间结构推理在功能区分和改进任务变化下的泛化能力方面的有效性。

英文摘要:

As robots are expected to perform increasingly diverse tasks, they must understand not only low-level actions but also the higher-level structure that determines how a task should unfold. Existing vision-language-action (VLA) models struggle with this form of task-level reasoning. They either depend on prompt-based in-context decomposition, which is unstable and sensitive to linguistic variations, or end-to-end long-horizon training, which requires large-scale demonstrations and entangles task-level reasoning with low-level control. We present in-parameter structured task reasoning (iSTAR), a framework for enhancing VLA models via functional differentiation induced by in-parameter structural reasoning. Instead of treating VLAs as monolithic policies, iSTAR embeds task-level semantic structure directly into model parameters, enabling differentiated task-level inference without external planners or handcrafted prompt inputs. This injected structure takes the form of implicit dynamic scene-graph knowledge that captures object relations, subtask semantics, and task-level dependencies in parameter space. Across diverse manipulation benchmarks, iSTAR achieves more reliable task decompositions and higher success rates than both in-context and end-to-end VLA baselines, demonstrating the effectiveness of parameter-space structural reasoning for functional differentiation and improved generalization across task variations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑