发表机构
State Key Lab of CAD&CG, Zhejiang University; Kahlert School of Computing, University of Utah(浙江大学计算机辅助设计与图形学国家重点实验室; 犹他大学卡勒特计算学院)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
本文针对现有3D高斯溅射(3DGS)变形方法易产生伪影的问题,提出一种交互式尽可能刚性(ARAP)变形方法,通过优化高斯及设计径向特征、自适应各向异性空间低通滤波器,实现无伪影且保持高质量高效率的高斯辐射场变形。
AI 中文摘要
3D高斯溅射(3DGS)将辐射场建模为稀疏分布的3D高斯,为高分辨率、实时帧率的新视图合成提供了极具吸引力的解决方案。然而,对由3D高斯表示的物体进行变形仍是一项具有挑战性的任务。现有方法通过对高斯进行几何编辑来变形3DGS物体,这些方法忽略了最终图像是由辐射场进行光栅化和渲染的这一事实。变形后的3D高斯与期望辐射场之间的不一致,不可避免地会导致最终结果出现伪影。在本文中,我们提出了一种用于高斯辐射场的尽可能刚性(ARAP)变形的交互式方法。具体而言,在对高斯进行几何编辑后,我们会进一步优化高斯,以确保其光栅化结果与变形后的辐射场相似。为了实现这一目标,我们设计了径向特征,以数学方式描述变形前后的径向差异,这些特征在辐射场中进行密集采样。此外,我们提出了一种自适应各向异性空间低通滤波器,以防止采样过程中的混叠问题,并在非均匀采样间隔变化时保持场的完整性。用户可以交互式地使用该工具,实现辐射场的大规模ARAP变形。由于我们的方法保持了变形前后高斯辐射场的一致性,因此避免了现有3DGS变形框架中常见的伪影,同时我们的方法保留了3DGS在渲染方面的高质量和高效率。
英文摘要
3D Gaussian Splatting (3DGS) models radiance fields as sparsely distributed 3D Gaussians, providing a compelling solution to novel view synthesis at high resolutions and real-time frame rates. However, deforming objects represented by 3D Gaussians remains a challenging task. Existing methods deform a 3DGS object by editing Gaussians geometrically. These approaches ignore the fact that it is the radiance field that rasterizes and renders the final image. The inconsistency between the deformed 3D Gaussians and the desired radiance field inevitably leads to artifacts in the final results. In this paper, we propose an interactive method for as-rigid-as-possible (ARAP) deformation of the Gaussian radiance fields. Specifically, after performing geometric edits on the Gaussians, we further optimize Gaussians to ensure its rasterization yields a similar result as the deformed radiance field. To facilitate this objective, we design radial features to mathematically describe the radial difference before and after the deformation, which are densely sampled across the radiance field. Additionally, we propose an adaptive anisotropic spatial low-pass filter to prevent aliasing issues during sampling and to preserve the field with the varying non-uniform sampling intervals. Users can interactively employ this tool to achieve large-scale ARAP deformations of the radiance field. Since our method maintains the consistency of the Gaussian radiance field before and after deformation, it avoids artifacts that are common in existing 3DGS deformation frameworks. Meanwhile, our method keeps the high quality and efficiency of 3DGS in rendering.
Journal refIEEE Transactions on Visualization and Computer Graphics, vol. 31, no. 10, pp. 7727-7739, Oct. 2025