arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2610.27242cs.RO
收藏

EmbodyHOI:面向人形灵巧操作的具身感知手-物体交互生成

EmbodyHOI: Embodiment-Aware Generation of Hand-Object Interactions for Humanoid Dexterous Manipulation

Carnegie Mellon University(卡内基梅隆大学)

Chaitanya Chawla, Kartik Sharma, Ananya Bal, Laszlo A. Jeni, Guanya Shi

AI总结:

提出EmbodyHOI方法,在HOI轨迹生成时引入人形具身的可微分逆运动学约束,缩小具身差距,显著降低手腕误差并提升任务成功率。

摘要:

人形灵巧操作需要对目标机器人而言兼具语义丰富性与运动学可行性的参考运动。文本条件手-物体交互(HOI)生成器可提供多样的、由语言指定的演示,但它们在人类(MANO)空间中合成运动。因此,具身差距被推迟到事后重定向阶段,此时部署在机器人上的轨迹可能无法保持与物体的接触,还会导致策略学习性能下降。我们的核心思路是:机器人可达性应在交互轨迹生成过程中对其进行约束。我们提出了EmbodyHOI,它在冻结的流匹配HOI轨迹生成器的采样循环中,为特定人形具身运行可微分逆运动学(IK)求解器。我们将具身感知IK求解器的梯度反馈给HOI采样器,并联合优化人形相对于物体的位置。由于该引导仅在推理时生效,因此一个在人类手部姿态上训练的HOI轨迹生成器无需重新训练即可跨人形具身迁移。在包含两种对比人形(Unitree G1和H1-2)的ARCTIC轨迹上,我们提出的基于引导的方法将重定向后的手腕误差从8.9厘米降至0.6厘米,同时保持文本到HOI的生成质量不变;在50个随机G1任务上,任务成功率从68%提升至79%,在四任务H1-2套件上从62%提升至76%。关键的是,用于弥合具身差距的更廉价替代方案均无法超越EmbodyHOI:事后手腕细化和计算匹配的最佳N选择虽达到比我们的引导更低的IK能量,但训练出的策略性能更差。模拟结果见我们的网站:this https URL

英文摘要:

Humanoid dexterous manipulation needs reference motions that are both semantically rich and kinematically feasible for the target robot. Text-conditioned hand-object interaction (HOI) generators supply diverse, language-specified demonstrations, but they synthesize motion in human (MANO) space. The embodiment gap is therefore deferred to post-hoc retargeting, where trajectories deployed on the robot can fail to maintain contact with objects and also degrade policy learning. Our key idea is that robot reachability should constrain the interaction trajectories while they are being generated. We present EmbodyHOI, which runs a differentiable inverse-kinematics (IK) solver for a specific humanoid embodiment inside the sampling loop of a frozen flow-matching HOI trajectory generator. We feed back gradients from the embodiment-aware IK solver into the HOI sampler and jointly optimize the position of the humanoid with respect to the object. Because guidance acts only at inference, one HOI trajectory generator trained on human hand poses transfers across humanoid embodiments without retraining. On ARCTIC trajectories with two contrasting humanoids (Unitree G1 and H1-2), our proposed guidance-based method cuts the retargeted wrist error from 8.9 cm to 0.6 cm while leaving text-to-HOI generation quality intact, and raises task success from 68% to 79% on 50 random G1 tasks and from 62% to 76% on a four-task H1-2 suite. Critically, cheaper alternatives for bridging the embodiment gap fail to beat EmbodyHOI. Post-hoc wrist refinement and compute-matched best-of-N selection both reach lower IK energy than our guidance yet train worse policies. For simulation results, see our website: https://embodyhoi.github.io/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑