SplatMesh：使用基于网格的高斯溅射进行交互式3D分割与编辑
SplatMesh: Interactive 3D Segmentation and Editing Using Mesh-Based Gaussian Splatting
AI总结：
针对细粒度3D交互式编辑中高效表示缺乏的问题，提出SplatMesh算法，集成3D高斯溅射与预计算网格，可调整内存请求，通过简化网格并对齐高斯溅射实现高效编辑，实验证明其在表示质量和编辑性能上更优。
摘要：
细粒度3D交互式编辑的关键挑战在于缺乏一种高效表示，能在给定内存约束下平衡多样修改与高质量视图合成。3D网格虽为各类修改提供鲁棒性，但视图合成质量常低于3D高斯溅射；而3D高斯溅射在大量编辑时又存在不稳定性。直接结合这两种表示会导致性能次优且无法满足内存约束。本文提出SplatMesh，一种新颖的细粒度交互式3D分割与编辑算法，将3D高斯溅射与预计算网格集成，并可根据需求调整内存请求。具体而言，给定网格，SplatMesh在考虑颜色和形状的同时简化网格，确保满足内存约束；然后将每个三角形视为新参考点，使高斯溅射与简化网格对齐。通过分割和编辑简化网格，可有效编辑高斯溅射。大量真实与合成数据集实验及直观视觉示例表明，该方法在表示质量和编辑性能上具有优越性。代码见：https://github.com/kaichen-z/SplatMesh。
英文摘要：
A key challenge in fine-grained 3D-based interactive editing is the absence of an efficient representation that balances diverse modifications with high-quality view synthesis under a given memory constraint. While 3D meshes provide robustness for various modifications, they often yield lower-quality view synthesis compared to 3D Gaussian Splatting, which, in turn, suffers from instability during extensive editing. A straightforward combination of these two representations results in suboptimal performance and fails to meet memory constraints. In this paper, we introduce SplatMesh, a novel fine-grained interactive 3D segmentation and editing algorithm that integrates 3D Gaussian Splat with a precomputed mesh and could adjust the memory request based on the requirement. Specifically, given a mesh, \method simplifies it while considering both color and shape, ensuring it meets memory constraints. Then, SplatMesh aligns Gaussian splats with the simplified mesh by treating each triangle as a new reference point. By segmenting and editing the simplified mesh, we can effectively edit the Gaussian splats as well, which will lead to extensive experiments on real and synthetic datasets, coupled with illustrative visual examples, highlighting the superiority of our approach in terms of representation quality and editing performance. Code of our paper can be found here: https://github.com/kaichen-z/SplatMesh.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
