arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2603.01436cs.RO

PhysGraph: 基于物理的图变换策略用于双臂灵巧手工具物体操作

PhysGraph: Physically-Grounded Graph-Transformer Policies for Bimanual Dexterous Hand-Tool-Object Manipulation

University of California, San Diego(加州大学圣地亚哥分校)

Runfa Blark Li, David Kim, Xinshuang Liu, Keito Suzuki, Dwait Bhatt, Nikola Raicevic, Xin Lin, Ki Myung Brian Lee, Nikolay Atanasov, Truong Nguyen

AI总结:

PhysGraph通过物理基础图变换策略提升双臂手工具物体操作的精度和成功率,仅用51%参数超越基线模型。

摘要:

双臂灵巧操作工具在机器人领域仍是一个严峻挑战,由于高维状态空间和复杂的接触动力学。现有方法简单地将整个系统状态表示为一个单一配置向量,忽略了关节手的丰富结构和拓扑信息。我们提出了PhysGraph,一种专门针对具有挑战性的双臂手工具物体操作的物理基础图变换策略。与先前工作不同,我们将双臂系统表示为运动学图,并引入了每链接标记化以保留细粒度的局部状态信息。我们提出了一种物理基础偏置生成器,将结构先验直接注入到注意力机制中,包括运动学空间距离、动态接触状态、几何接近性和解剖学特性。这使策略能够显式推理物理交互,而不是从稀疏奖励中隐式学习。大量实验表明,PhysGraph在操作精度和任务成功率方面显著优于基线-ManipTrans,同时仅使用ManipTrans参数的51%。此外,我们架构的内在拓扑灵活性显示了对未见过的工具/物体几何的定性零样本转移,并且足够通用,可以训练在三种机器人手(Shadow、Allegro、Inspire)上。

英文摘要:

Bimanual dexterous manipulation for tool use remains a formidable challenge in robotics due to the high-dimensional state space and complicated contact dynamics. Existing methods naively represent the entire system state as a single configuration vector, disregarding the rich structural and topological information inherent to articulated hands. We present PhysGraph, a physically-grounded graph transformer policy designed explicitly for challenging bimanual hand-tool-object manipulation. Unlike prior works, we represent the bimanual system as a kinematic graph and introduce per-link tokenization to preserve fine-grained local state information. We propose a physically-grounded bias generator that injects structural priors directly into the attention mechanism, including kinematic spatial distance, dynamic contact states, geometric proximity, and anatomical properties. This allows the policy to explicitly reason about physical interactions rather than learning them implicitly from sparse rewards. Extensive experiments show that PhysGraph significantly outperforms baseline - ManipTrans in manipulation precision and task success rates while using only 51% of the parameters of ManipTrans. Furthermore, the inherent topological flexibility of our architecture shows qualitative zero-shot transfer to unseen tool/object geometries, and is sufficiently general to be trained on three robotic hands (Shadow, Allegro, Inspire).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑