AI 中文总结
该研究针对现有HOI生成方法难以处理多物体及铰接式物体交互的问题，提出表面关键点轨迹表示与时空接触距离场，通过三阶段框架实现HOI生成，在多数据集上表现优异。
AI 中文摘要
日常活动要求人类协调全身运动与周围物体的运动。尽管近期人-物体交互（HOI）生成领域取得了进展，但大多数现有方法假设交互对象为单个刚性物体，难以很好地扩展到涉及可变数量物体或具有不同关节机制的铰接式物体的场景。我们提出表面关键点轨迹作为物体运动表示：对于每个刚性组件，无论是独立物体还是铰接组件的一部分，我们随时间跟踪一小组非共线表面点。该表示直接通过点动力学处理多物体协调和不同的关节机制，无需明确指定关节类型。为了建模每个身体区域与每个物体的接触时间和位置，我们引入了时空接触距离场，将基于距离的接触建模扩展到全身、多物体和铰接式场景。我们将HOI生成分解为三个阶段：从文本或航路点生成物体运动、预测接触距离场、通过接触引导优化合成全身运动。在ParaHome、HIMO、ARCTIC和OMOMO数据集上的实验表明，该方法在单物体、多物体和铰接式交互场景中均达到了优于或与现有方法相当的性能。
英文摘要
Daily activities require humans to coordinate whole-body motion with the motion of surrounding objects. Despite recent progress in human-object interaction (HOI) generation, most existing methods assume interactions with a single rigid object and do not extend well to scenarios involving a variable number of objects or articulated objects with diverse joint mechanisms. We propose surface keypoint trajectories as an object motion representation: for each rigid component, whether a standalone object or one part of an articulated assembly, we track a small set of non-collinear surface points over time. This representation handles multi-object coordination and diverse articulation mechanisms directly from point dynamics without requiring explicit joint-type specification. To model when and where each body region contacts each object, we introduce a spatio-temporal contact distance field that extends distance-based contact modeling to whole-body, multi-object, and articulated settings. We factorize HOI generation into three stages: generating object motions from text or waypoints, predicting the contact distance field, and synthesizing whole-body motion with contact-guided optimization. Experiments on ParaHome, HIMO, ARCTIC, and OMOMO demonstrate better or comparable performance to existing methods across single-object, multi-object, and articulated interaction settings.
CommentsProject page: https://neu-vi.github.io/SK-HOI
