arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2606.24876cs.CV

FLAT: 前馈潜在三角形泼溅用于几何精确的场景生成

FLAT: Feedforward Latent Triangle Splatting for Geometrically Accurate Scene Generation

Google Research(谷歌研究院);University of Oxford, Visual Geometry Group(牛津大学视觉几何组);TU Munich(慕尼黑工业大学)

Orest Kupyn, Goutam Bhat, Philipp Henzler, Fabian Manhardt, Christian Rupprecht, Federico Tombari

AI总结:

提出FLAT方法,首次从视频扩散潜在表示中直接解码三角形泼溅,通过射线中心旋转参数化和乘积窗口函数解决梯度流问题,在保持视觉质量的同时显著提升几何精度。

摘要:

从单张图像生成可探索的3D场景需要强大的生成先验和适用于下游任务的精确几何表示。当前的视频扩散模型提供高质量生成,并在潜在空间中隐式编码多视图几何结构。然而,现有的前馈潜在场景解码器通常输出缺乏明确表面的体积3D高斯,限制了其在仿真或标准图形管线中的使用。这促使我们解码表面对齐的基元,这些基元不仅可渲染,而且更接近显式几何资产。我们探究是否可以将压缩的视频扩散潜在表示直接映射到显式表面基元。为此,我们引入FLAT,并首次展示三角形泼溅可以直接从视频扩散潜在表示中解码。与解码3D高斯相比,预测平面基元由于对基元方向的高度敏感性而更具挑战性,常常导致梯度流不佳。FLAT通过两个关键成分解决:用于三角形回归的射线中心旋转参数化,以及一种新颖的乘积窗口函数,该函数改进了可微三角形渲染期间的梯度流。在标准基准上,FLAT实现了显著更好的几何精度,同时与最先进的前馈基线相比保持了竞争力的视觉质量。我们进一步展示,一个轻量级的测试时细化步骤将预测的三角形汤转换为完全不透明的、游戏引擎就绪的表示,支持实时渲染。通过在相同训练设置下评估3DGS、2DGS和三角形泼溅变体,我们首次对前馈场景生成中的表示权衡进行了系统分析。项目页面见该网址。

英文摘要:

Generating explorable 3D scenes from a single image requires strong generative priors and accurate geometric representations suitable for downstream use. Current video diffusion models offer high-quality generation and implicitly encode multi-view geometric structure in latent space. However, existing feedforward latent scene decoders typically output volumetric 3D Gaussians that lack a well-defined surface, limiting their use in simulation or standard graphics pipelines. This motivates decoding surface-aligned primitives that are not only renderable but also closer to explicit geometric assets. We ask whether compressed video diffusion latents can be mapped directly to explicit surface primitives in a single pass. To this end, we introduce FLAT and, for the first time, show that triangle splats can be decoded directly from video diffusion latents. Compared with decoding 3D Gaussians, predicting flat primitives is notoriously more challenging due to high sensitivity to primitive orientations, oftentimes leading to poor gradient flow. FLAT solves with two key ingredients: a ray-centered rotation parameterization for triangle regression and a novel product window function that improves gradient flow during differentiable triangle rendering. On standard benchmarks, FLAT achieves significantly better geometric accuracy while maintaining competitive visual quality compared to state-of-the-art feedforward baselines. We further show that a lightweight test-time refinement step converts the predicted triangle soup into a fully opaque, game-engine-ready representation that supports real-time rendering. By evaluating 3DGS, 2DGS, and triangle splatting variants under an identical training setup, we provide the first systematic analysis of representation tradeoffs in feedforward scene generation. The project page is available at https://flat-splat.github.io

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑