arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.22016cs.HCcs.CV
收藏

SketchPlay: 通过手势驱动的草图直观创建物理真实的VR内容

SketchPlay: Intuitive Creation of Physically Realistic VR Content with Gesture-Driven Sketching

Beijing Technology and Business University(北京技术与商业大学);The University of Sydney(悉尼大学)

Xiangwen Zhang, Xiaowei Dai, Runnan Chen, Xiaoming Chen, Zeke Zexi Hu

AI总结:

SketchPlay通过手势驱动的草图创建直观的物理真实VR内容,提升非专家用户的创作体验和应用潜力。

摘要:

在VR中创建物理真实的 内容往往需要复杂的建模工具或预定义的3D模型、纹理和动画,这对非专家用户来说是一个显著的障碍。在本文中,我们提出了SketchPlay,一种新的VR交互框架,将人类的空中绘制草图和手势转化为动态、物理真实的场景,使内容创作变得直观且有趣,如同绘画。具体而言,草图捕捉物体和场景的结构和空间布局,而手势传达物理线索,如速度、方向和力度,这些定义了运动和行为。通过结合这两种互补的输入形式,SketchPlay捕捉用户创建内容的结构和动态,使生成各种复杂的物理现象成为可能,如刚体运动、弹性变形和布料动态。实验结果表明,与传统文本驱动方法相比,SketchPlay在表达性和用户体验方面具有显著优势。通过提供直观且吸引人的创作过程,SketchPlay降低了非专家用户的入门门槛,并在教育、艺术和沉浸式叙事等领域显示出强劲的应用潜力。

英文摘要:

Creating physically realistic content in VR often requires complex modeling tools or predefined 3D models, textures, and animations, which present significant barriers for non-expert users. In this paper, we propose SketchPlay, a novel VR interaction framework that transforms humans' air-drawn sketches and gestures into dynamic, physically realistic scenes, making content creation intuitive and playful like drawing. Specifically, sketches capture the structure and spatial arrangement of objects and scenes, while gestures convey physical cues such as velocity, direction, and force that define movement and behavior. By combining these complementary forms of input, SketchPlay captures both the structure and dynamics of user-created content, enabling the generation of a wide range of complex physical phenomena, such as rigid body motion, elastic deformation, and cloth dynamics. Experimental results demonstrate that, compared to traditional text-driven methods, SketchPlay offers significant advantages in expressiveness, and user experience. By providing an intuitive and engaging creation process, SketchPlay lowers the entry barrier for non-expert users and shows strong potential for applications in education, art, and immersive storytelling.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑