arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.15736cs.GRcs.CV

通过噪声引导的溅射修复虚假透明

Fix False Transparency by Noise Guided Splatting

OpsiClear LLC(OpsiClear公司);Case Western Reserve University(凯斯西储大学)

Aly El Hakie, Yiren Lu, Yu Yin, Michael Jenkins, Yehe Liu

AI总结:

针对3DGS重建中不透明物体出现虚假透明的问题,提出NGS方法,通过注入不透明噪声高斯提升表面不透明度,并引入透射率度量与定制数据集,实验证明有效减少伪影且保持渲染性能。

摘要:

由3DGS重建的不透明物体通常表现出虚假透明的表面,在交互式观看中,当相机运动时会导致背景和内部图案不一致。此问题源于3DGS中的不适定优化。在训练过程中,背景和前景高斯通过alpha合成进行混合,并仅使用光度损失针对输入RGB图像进行优化。由于此过程缺乏对表面不透明度的显式约束,优化可能错误地将透明性分配给不透明区域,导致视图不一致和虚假透明。此问题在标准评估设置中难以检测,但在交互式观看下的以物体为中心的重建中尤为明显。尽管最近已探索了视图不一致的其他原因,但虚假透明尚未被明确识别。据我们所知,我们是第一个识别、表征并开发针对此伪影(3DGS中未充分报告的伪影)的解决方案的团队。我们的策略NGS通过在训练期间向物体体积中注入不透明噪声高斯,鼓励表面高斯采用更高的不透明度,仅需对现有溅射过程进行最小修改。为了定量评估静态渲染中的虚假透明,我们提出了一种基于透射率的度量,用于衡量此伪影的严重程度。此外,我们引入了一个定制的、高质量的以物体为中心的扫描数据集,该数据集表现出明显的透明问题,并增强了流行的现有数据集,补充了专门设计用于评估3D重建方法对虚假透明鲁棒性的填充噪声。跨多个数据集的实验表明,NGS在保持标准渲染指标上竞争性能的同时,显著减少了虚假透明,证明了其整体有效性。

英文摘要:

Opaque objects reconstructed by 3DGS often exhibit a falsely transparent surface, leading to inconsistent background and internal patterns under camera motion in interactive viewing. This issue stems from the ill-posed optimization in 3DGS. During training, background and foreground Gaussians are blended via alpha-compositing and optimized solely against the input RGB images using a photometric loss. As this process lacks an explicit constraint on surface opacity, the optimization may incorrectly assign transparency to opaque regions, resulting in view-inconsistent and falsely transparent. This issue is difficult to detect in standard evaluation settings but becomes particularly evident in object-centric reconstructions under interactive viewing. Although other causes of view-inconsistency have been explored recently, false transparency has not been explicitly identified. To the best of our knowledge, we are the first to identify, characterize, and develop solutions for this artifact, an underreported artifact in 3DGS. Our strategy, NGS, encourages surface Gaussians to adopt higher opacity by injecting opaque noise Gaussians in the object volume during training, requiring only minimal modifications to the existing splatting process. To quantitatively evaluate false transparency in static renderings, we propose a transmittance-based metric that measures the severity of this artifact. In addition, we introduce a customized, high-quality object-centric scan dataset exhibiting pronounced transparency issues, and we augment popular existing datasets with complementary infill noise specifically designed to assess the robustness of 3D reconstruction methods to false transparency. Experiments across multiple datasets show that NGS substantially reduces false transparency while maintaining competitive performance on standard rendering metrics, demonstrating its overall effectiveness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑