发表机构
School of Computer Science and Engineering, Sun Yat-sen University; School of Systems Science and Engineering, Sun Yat-sen University; Guangdong Province Key Laboratory of Information Security Technology, Sun Yat-sen University(中山大学计算机科学与工程学院; 中山大学系统科学与工程学院; 中山大学广东省信息安全技术重点实验室)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
提出VersaGauss框架,以少量图像为输入,结合粒子剪枝算法、耦合多相点法等技术,实现多材料多相交互的逼真物理驱动3D动态场景生成与模拟。
AI 中文摘要
近期,3D高斯表示在重建、生成和物理模拟方面已取得进展,但现有方法主要聚焦于基于物理的固体对象动态生成,仅能处理单相碰撞交互。本文提出VersaGauss,这是一个支持通用基于物理的动态生成(尤其针对多相交互)的统一生成、模拟与渲染框架。该系统以少量图像为输入,生成包含多个对象的逼真、物理驱动的3D动态场景;为优化高斯核分布,开发了粒子剪枝算法,还提出耦合多相点法(CMPM)以有效建模和生成多相交互,同时引入CMPM内的调和插值与高斯演化策略实现逼真流体渲染。大量实验表明,该框架可模拟流体、橡胶、沙子、雪等多种材料间的交互,代码可在指定URL获取。
英文摘要
Recent progress has been made in 3D Gaussian representation for reconstruction, generation, and physical simulation. However, current approaches mainly concentrate on physics-based dynamic generation of solid objects and only handle single-phase collision interactions. We introduce VersaGauss, a unified framework for generation, simulation, and rendering that supports versatile physics-based dynamic generation, particularly for multiphase interactions. Our system takes a few images as input and produces a realistic, physics-driven 3D dynamic scene with multiple objects. To optimize the Gaussian kernel distribution, we develop a particle pruning algorithm. We also propose the Coupled Multiphase Point Method (CMPM) to effectively model and generate multiphase interactions. Additionally, harmonic interpolation within CMPM and a Gaussian evolution strategy are introduced to achieve realistic fluid rendering. Extensive experiments demonstrate that our framework can simulate interactions among various materials such as fluid, rubber, sand, snow, and others. Code is available at https://github.com/Elowen-surj/VersaGauss.