arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.03210cs.CVcs.LGcs.RO
收藏

Flux4D: 基于流的无监督4D重建

Flux4D: Flow-based Unsupervised 4D Reconstruction

Waabi;University of Toronto(多伦多大学);UIUC(伊利诺伊大学香槟分校)

Jingkang Wang, Henry Che, Yun Chen, Ze Yang, Lily Goli, Sivabalan Manivasagam, Raquel Urtasun

AI总结:

Flux4D通过无监督学习直接从原始数据中重建大规模动态场景,无需预训练模型或先验知识,实现高效且可扩展的4D重建。

摘要:

从视觉观测中重建大规模动态场景是计算机视觉中的基本挑战,对机器人和自主系统具有关键意义。尽管最近的可微渲染方法如神经辐射场(NeRF)和3D高斯点撒(3DGS)已取得令人印象深刻的逼真重建效果,但它们存在可扩展性限制,并且需要注释来解耦演员运动。现有的自监督方法尝试通过利用运动线索和几何先验来消除显式注释,但仍然受限于每场景优化和对超参数调优的敏感性。在本文中,我们引入了Flux4D,一种简单且可扩展的框架,用于大规模动态场景的4D重建。Flux4D直接预测3D高斯和其运动动态,以在完全无监督的方式下重建传感器观测。通过仅使用光度损失并施加“尽可能静态”的正则化,Flux4D学会从原始数据中直接分解动态元素,而无需预训练的监督模型或基础先验,仅通过在多个场景上训练即可。我们的方法使在几秒钟内高效重建动态场景成为可能,能够有效扩展到大规模数据集,并在未见过的环境中泛化良好,包括罕见和未知的对象。在户外驾驶数据集上的实验表明,Flux4D在可扩展性、泛化能力和重建质量上显著优于现有方法。

英文摘要:

Reconstructing large-scale dynamic scenes from visual observations is a fundamental challenge in computer vision, with critical implications for robotics and autonomous systems. While recent differentiable rendering methods such as Neural Radiance Fields (NeRF) and 3D Gaussian Splatting (3DGS) have achieved impressive photorealistic reconstruction, they suffer from scalability limitations and require annotations to decouple actor motion. Existing self-supervised methods attempt to eliminate explicit annotations by leveraging motion cues and geometric priors, yet they remain constrained by per-scene optimization and sensitivity to hyperparameter tuning. In this paper, we introduce Flux4D, a simple and scalable framework for 4D reconstruction of large-scale dynamic scenes. Flux4D directly predicts 3D Gaussians and their motion dynamics to reconstruct sensor observations in a fully unsupervised manner. By adopting only photometric losses and enforcing an "as static as possible" regularization, Flux4D learns to decompose dynamic elements directly from raw data without requiring pre-trained supervised models or foundational priors simply by training across many scenes. Our approach enables efficient reconstruction of dynamic scenes within seconds, scales effectively to large datasets, and generalizes well to unseen environments, including rare and unknown objects. Experiments on outdoor driving datasets show Flux4D significantly outperforms existing methods in scalability, generalization, and reconstruction quality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑