开放词汇功能3D人类-场景交互生成
Open-Vocabulary Functional 3D Human-Scene Interaction Generation
AI总结：
FunHSI通过功能驱动框架生成开放词汇任务下的功能正确3D人类-场景交互。
摘要：
生成能够与3D场景功能交互的3D人类仍是一个开放性问题，应用领域包括具身人工智能、机器人和交互内容创作。关键挑战在于推理解析3D场景中功能元素的语义以及实现功能感知交互所需的3D人类姿态。不幸的是，现有方法通常缺乏对物体功能性和相应的人-场景接触的显式推理，导致不真实或功能不正确的交互。在本工作中，我们提出FunHSI，一种无需训练的功能驱动框架，能够从开放词汇任务提示中生成功能正确的交互。给定一个任务提示，FunHSI进行功能感知接触推理，以识别功能场景元素，重建其3D几何，并通过接触图建模高层次交互。然后利用视觉-语言模型合成执行任务的人形在图像中，并估计所提出的3D身体和手姿态。最后，所提出的3D身体配置通过分阶段优化进行细化，以确保物理合理性和功能正确性。与现有方法相比，FunHSI不仅合成出更合理的通用3D交互，如“坐在沙发上”，同时支持细粒度的功能人-场景交互，如“提高房间温度”。大量实验表明，FunHSI在多样化的室内和室外场景中一致地生成功能正确且物理合理的交互。
英文摘要：
Generating 3D humans that functionally interact with 3D scenes remains an open problem with applications in embodied AI, robotics, and interactive content creation. The key challenge involves reasoning about both the semantics of functional elements in 3D scenes and the 3D human poses required to achieve functionality-aware interaction. Unfortunately, existing methods typically lack explicit reasoning over object functionality and the corresponding human-scene contact, resulting in implausible or functionally incorrect interactions. In this work, we propose FunHSI, a training-free, functionality-driven framework that enables functionally correct human-scene interactions from open-vocabulary task prompts. Given a task prompt, FunHSI performs functionality-aware contact reasoning to identify functional scene elements, reconstruct their 3D geometry, and model high-level interactions via a contact graph. We then leverage vision-language models to synthesize a human performing the task in the image and estimate proposed 3D body and hand poses. Finally, the proposed 3D body configuration is refined via stage-wise optimization to ensure physical plausibility and functional correctness. In contrast to existing methods, FunHSI not only synthesizes more plausible general 3D interactions, such as "sitting on a sofa'', while supporting fine-grained functional human-scene interactions, e.g., "increasing the room temperature''. Extensive experiments demonstrate that FunHSI consistently generates functionally correct and physically plausible human-scene interactions across diverse indoor and outdoor scenes.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
