arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2602.06343cs.CV

考虑不确定性的4D高斯点散布用于单目遮挡人体渲染

Uncertainty-Aware 4D Gaussian Splatting for Monocular Occluded Human Rendering

Zhejiang University(浙江大学);The Hong Kong University of Science and Technology(香港科技大学)

Weiquan Wang, Feifei Shao, Lin Li, Zhen Wang, Fengda Zhang, Jun Xiao, Long Chen

AI总结:

本文提出U-4DGS框架,通过概率变形网络和联合光栅化流程,在异方差观测噪声下实现最大后验估计,解决单目视频中遮挡导致的高保真动态人体渲染问题。

摘要:

单目视频中动态人体的高保真渲染在遮挡情况下通常严重退化。现有方法采用外部先验知识,要么通过生成模型 hallucinate 缺失内容导致严重时间闪烁,要么采用刚性几何启发式方法无法捕捉多样外观。为此,我们将任务重新表述为在异方差观测噪声下的最大后验估计问题。本文提出U-4DGS框架,整合概率变形网络和联合光栅化流程。该架构渲染像素对齐的不确定性图,作为自适应梯度调节器,自动衰减不可靠观测中的伪影。此外,为防止缺乏可靠视觉线索区域的几何漂移,我们强制实施置信度感知正则化,利用学习到的不确定性选择性传播时空有效性。在ZJU-MoCap和OcMotion数据集上的大量实验表明,U-4DGS实现了最先进的渲染保真度和鲁棒性。

英文摘要:

High-fidelity rendering of dynamic humans from monocular videos typically degrades catastrophically under occlusions. Existing solutions incorporate external priors-either hallucinating missing content via generative models, which induces severe temporal flickering, or imposing rigid geometric heuristics that fail to capture diverse appearances. To this end, we reformulate the task as a Maximum A Posteriori estimation problem under heteroscedastic observation noise. In this paper, we propose U-4DGS, a framework integrating a Probabilistic Deformation Network and a Joint Rasterization pipeline. This architecture renders pixel-aligned uncertainty maps that act as an adaptive gradient modulator, automatically attenuating artifacts from unreliable observations. Furthermore, to prevent geometric drift in regions lacking reliable visual cues, we enforce Confidence-Aware Regularizations, which leverage the learned uncertainty to selectively propagate spatial-temporal validity. Extensive experiments on the ZJU-MoCap and OcMotion datasets demonstrate that U-4DGS achieves state-of-the-art rendering fidelity and robustness.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑