arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

VirSqueezer:从细粒度挤压控制生成VR中逼真的变形与挤压动力学

VirSqueezer: Generating Realistic Deformations and Squeezing Dynamics in VR from Fine-Grained Squeezing Controls

Qian Zhang, Xiaoming Chen, Xiaorui Ma, Haisheng Li, Weidong Cai

arXiv 2609.01698首次发表:更新:

发表机构

Beijing Technology and Business University; The University of Sydney(北京工商大学; 悉尼大学)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

提出VirSqueezer框架,结合SenseGlove捕捉细粒度挤压控制信号,生成VR中逼真的局部变形与挤压动力学,经评估效果良好。

AI 中文摘要

挤压是手部操作最自然的形式之一,本质上涉及细粒度、随时间变化的单指弯曲。在VR内容创作中,挤压在实现特定视觉效果(如局部变形和动态行为,例如压爆可乐罐或榨汁)方面发挥着独特作用,从而拓展了VR内容的表现可能性。然而,现有技术(如基于3D Gaussian splatting的方法和基于扩散的视频生成模型)在模拟细粒度虚拟挤压效果方面存在局限。我们提出VirSqueezer,这一框架旨在生成局部变形(主要效果)和复杂挤压动力学(如破裂与溢出,次要效果)。VirSqueezer通过SenseGlove捕捉挤压控制信号,并在挤压过程中为用户提供推断的阻力反馈;通过估计物体接触区域、推断物理属性并模拟物理响应,计算指导生成模型生成视觉效果的条件,确保视觉连贯性以及与模拟的时间同步。因此,VirSqueezer可直接从连续、细粒度的挤压控制信号生成物理上逼真的视觉效果。我们的广泛评估表明,VirSqueezer具备重现逼真局部变形、生成令人信服的视觉动态以及保持细粒度挤压控制一致性的能力。

英文摘要

Squeezing is one of the most natural forms of hand manipulation, inherently involving fine-grained, temporally evolving, per-finger flexion. In VR content creation, squeezing plays a unique role in enabling particular visual effects such as localized deformations and dynamic behaviors, e.g., bursting a Coke can or juicing a fruit, thereby expanding the expressive possibilities of VR content. However, existing techniques, such as 3D Gaussian splatting-based methods and diffusion-based video generation models, are limited in their ability to simulate fine-grained virtual squeezing effects. We introduce VirSqueezer, a framework designed to generate both localized deformations (primary effects) and complex squeezing dynamics, such as rupture and overflow (secondary effects). VirSqueezer captures squeezing control signals using a SenseGlove and provides the user with inferred resistance force feedback during the squeezing process. By estimating object contact areas, inferring physical properties, and simulating physical responses, VirSqueezer computes conditions that guide generation models for visual effect generation, ensuring both visual coherence and temporal synchronization with the simulation. Consequently, VirSqueezer enables the generation of physically realistic visual effects directly from continuous, fine-grained squeezing control signals. Our extensive evaluation demonstrates VirSqueezer's ability to reproduce realistic localized deformations, generate convincing visual dynamics, and maintain consistency in fine-grained squeezing controls.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑