3DGS-to-PC:将3D高斯泼溅场景转换为密集点云或网格
3DGS-to-PC: Convert a 3D Gaussian Splatting Scene into a Dense Point Cloud or Mesh
AI总结:
针对3DGS场景需专用渲染器、难转通用点云的问题,提出3DGS-to-PC框架,通过概率采样、马氏距离过滤、重算颜色等生成高精度点云,还支持无重训练生成网格,可便捷集成到现有3DGS流程。
摘要:
3D高斯泼溅(3D Gaussian Splatting, 3DGS)擅长生成高度精细的3D重建结果,但这类场景通常需要专用渲染器才能有效可视化。相比之下,点云是一种应用广泛的3D表示形式,兼容大多数主流3D处理软件,然而将3DGS场景转换为点云是一项复杂的挑战。在本研究中,我们提出了3DGS-to-PC,这是一个灵活且高度可定制的框架,能够将3DGS场景转换为密集、高精度的点云。我们将每个高斯分布视为3D密度函数,从中按概率采样点。此外,我们利用到高斯中心的马氏距离对新生成的点进行阈值过滤,以排除极端离群值,最终得到的点云能够精准还原3D高斯场景中编码的形状。单个高斯分布通过球谐函数实现颜色随视角变化,而每个点对最终渲染场景的颜色贡献可能十分微弱。为避免出现与最终点云不符的杂色或错误颜色,我们通过定制化的图像渲染方法重新计算高斯分布的颜色,为每个高斯分配其在所有视角中贡献最大的像素对应的颜色。3DGS-to-PC还支持通过泊松表面重建生成网格,该重建过程作用于从预测的表面高斯分布中采样得到的点,无需重新训练即可从3DGS场景生成带颜色的网格。该工具包高度可定制,能够轻松集成到现有的3DGS工作流中,为将3DGS数据转换为点云和基于表面的格式提供了强大的工具。
英文摘要:
3D Gaussian Splatting (3DGS) excels at producing highly detailed 3D reconstructions, but these scenes often require specialised renderers for effective visualisation. In contrast, point clouds are a widely used 3D representation and are compatible with most popular 3D processing software, yet converting 3DGS scenes into point clouds is a complex challenge. In this work we introduce 3DGS-to-PC, a flexible and highly customisable framework that is capable of transforming 3DGS scenes into dense, high-accuracy point clouds. We sample points probabilistically from each Gaussian as a 3D density function. We additionally threshold new points using the Mahalanobis distance to the Gaussian centre, preventing extreme outliers. The result is a point cloud that closely represents the shape encoded into the 3D Gaussian scene. Individual Gaussians use spherical harmonics to adapt colours depending on view, and each point may contribute only subtle colour hints to the resulting rendered scene. To avoid spurious or incorrect colours that do not fit with the final point cloud, we recalculate Gaussian colours via a customised image rendering approach, assigning each Gaussian the colour of the pixel to which it contributes most across all views. 3DGS-to-PC also supports mesh generation through Poisson Surface Reconstruction, applied to points sampled from predicted surface Gaussians. This allows coloured meshes to be generated from 3DGS scenes without the need for re-training. This package is highly customisable and capability of simple integration into existing 3DGS pipelines. 3DGS-to-PC provides a powerful tool for converting 3DGS data into point cloud and surface-based formats.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。