arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.26043cs.RO
收藏

OmniInteract:面向双人形机器人的统一全身交互控制

OmniInteract: Towards Unified Whole-Body Interaction Control for Dual Humanoids

School of Computer Science and Engineering, Sun Yat-sen University(中山大学计算机科学与工程学院);Shenzhen Loop Area Institute(深圳河套学院);Beijing Institute of Technology(北京理工大学);The Hong Kong University of Science and Technology(香港科技大学)

Yinghao Li, Tianyu Zhang, Zhuohao Li, Yi-Lin Wei, Fa-Ting Hong, Qing Zhang, Wei-Shi Zheng

AI总结:

OmniInteract通过表面接触感知重定向与可扩展流交互策略,解决双人形机器人交互的形态差异与控制保真度问题,提升了交互性能与协调能力,可成功部署于实际场景。

摘要:

物理交互是人形机器人协作的核心能力,需要协调的全身运动与精准接触。然而,学习多样化的双人形机器人交互面临两大挑战:(1)人-机器人的形态差异会在重定向过程中破坏接触界面与空间关系;(2)联合学习运动技能与伙伴协调会导致随着交互多样性提升,控制保真度难以保持。本文提出OmniInteract以解决上述挑战,采用感知表面建模与可扩展残差策略学习。首先,引入表面接触感知重定向,利用密集人-机器人表面对应关系对双人形机器人进行联合重定向,保留显式交互接触界面及其近场几何上下文。其次,提出基于流的可扩展交互策略,用于伙伴条件下的残差生成,将双人形机器人控制分解为可复用的运动基础与交互特定适配:感知伙伴的专家在冻结的全身运动先验上学习修正,而条件流匹配将其统一在共享残差动作空间中,实现可扩展的技能整合同时保留预训练的运动能力。大量实验表明,OmniInteract提升了重定向保真度与双人形机器人协调能力,且在技能多样性提升时更好地保留了交互性能;实际部署进一步验证了其能成功建立接触、实现稳定全身协调并从外部扰动中恢复。

英文摘要:

Physical interaction is a key capability for humanoid collaboration, requiring coordinated whole-body motion and precise contact. However, learning diverse dual-humanoid interactions faces two major challenges: (1) human-robot morphological differences disrupt contact interfaces and spatial relationships during retargeting, and (2) jointly learning motor skills and partner coordination makes it difficult to retain control fidelity as interaction diversity grows. In this paper, we propose OmniInteract to address these challenges through surface-aware modeling and scalable residual policy learning. First, we introduce Surface Contact-Aware Retargeting, which leverages dense human-robot surface correspondences to jointly retarget both humanoids, preserving explicit interaction contact interfaces and their near-field geometric context. Second, we propose a Scalable Flow-based Interaction Policy for partner-conditioned residual generation. It factorizes dual-humanoid control into a reusable motor foundation and interaction-specific adaptations: partner-aware experts learn corrections over a frozen whole-body motion prior, while conditional flow matching unifies them in a shared residual action space. This enables scalable skill consolidation while retaining pretrained motor capabilities. Extensive experiments demonstrate that OmniInteract improves retargeting fidelity and dual-humanoid coordination while better retaining interaction performance as skill diversity grows. Real-world deployment further demonstrates successful contact establishment, stable whole-body coordination, and recovery from external perturbations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑