SplashSplat：从真实世界多视角视频重建飞溅液体

发表机构

Google; ETH; Microsoft; EPFL（谷歌; 苏黎世联邦理工学院; 微软; 洛桑联邦理工学院）

AI 中文总结

针对真实世界飞溅液体重建，提出SplashSplat方法，利用掩码融合SDF、水平集输运和拉格朗日载体解码高斯，在20个真实场景基准上超越现有方法，且支持时间插值与风格迁移。

AI 中文摘要

飞溅仅持续一瞬间：液膜撕裂成韧带和液滴，其外观依赖于视角且几乎无纹理，几乎没有足够长的特征可供追踪。因此，重建研究一直聚焦于烟雾、合成液体或缓慢变形的表面。据我们所知，目前尚不存在同步的多视角飞溅液体数据集。为此，我们引入了一个包含20个真实场景的基准，涵盖从连贯水流到剧烈飞溅的各种情况，这些场景由七台同步校准的4K摄像机以60帧每秒的速度捕获，并配有手动细化的逐视角液体和容器掩码以及固定的评估划分。我们还提出了SplashSplat，其构建基于一个原则：仅在观测能够约束的地方施加物理结构。从掩码融合得到的逐帧液体有符号距离场（SDF）提供几何信息，连续SDF之间的水平集输运产生粗略的速度场，沿该流平流的拉格朗日载体，针对每个新观测进行校正并在覆盖丢失处重新播种，解码局部高斯以进行可微渲染。SplashSplat在我们的真实捕获数据和合成基准上均优于最先进的动态高斯泼溅方法，具有物理上更合理的运动且训练成本更低。相同的表示还支持时间插值和风格迁移，无需重新优化。

英文摘要

A splash lives for a fraction of a second: sheets tear into ligaments and droplets, appearance is view-dependent and nearly textureless, and little persists long enough to track. Reconstruction research has consequently focused on smoke, synthetic liquids, or gently deforming surfaces. To our knowledge, no synchronized multi-view dataset of splashing liquids exists. We therefore introduce a benchmark of 20 real scenes, from coherent streams to violent splashes, captured by seven synchronized, calibrated 4K cameras at 60 fps, with manually refined per-view liquid and container masks and fixed evaluation splits. We further present SplashSplat, built on a single principle: impose physical structure only where the observations can constrain it. Per-frame liquid SDFs fused from the masks provide the geometry, level-set transport between consecutive SDFs yields a coarse velocity field, and Lagrangian carriers advected along this flow, corrected against each new observation and reseeded where coverage is lost, decode local Gaussians for differentiable rendering. SplashSplat outperforms state-of-the-art dynamic Gaussian splatting methods on our real captures and on a synthetic benchmark, with physically more plausible motion and a lower training cost. The same representation supports temporal interpolation and style transfer without re-optimization.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

相关深度报道

• 水花飞溅也能3D定格！谷歌微软联合打造SplashSplat，高斯泼溅攻克流体重建
• 七台4K相机抓住一瞬水花，谷歌微软把真实飞溅重建成3D