ProvNeRF:将NeRF中的逐点来源建模为随机场
ProvNeRF: Modeling per Point Provenance in NeRFs as a Stochastic Field
AI总结:
针对现有NeRF未显式建模训练相机位姿分布与三角测量质量的问题,提出ProvNeRF将逐点可见来源建模为随机场,通过扩展IMLE到带可优化目标的函数空间实现,在稀疏无约束视图下提升了新视角合成与不确定性估计效果。
摘要:
神经辐射场(Neural radiance fields, NeRFs)已获得广泛关注,多项研究在各类应用中展现出可观成果。但据我们所知,现有工作并未显式建模训练相机位姿的分布,也未因此建模三角测量质量——这是可追溯至经典视觉文献的、影响重建质量的关键因素。我们通过ProvNeRF填补了这一空白,该方法将NeRF中每个点的**来源**(即该点可能可见的位置)建模为一个随机场。我们通过将隐式最大似然估计(implicit maximum likelihood estimation, IMLE)扩展到带有可优化目标的函数空间来实现这一点。我们表明,在NeRF优化过程中建模逐点来源,能为模型补充三角测量相关信息,在具有挑战性的稀疏、无约束视图设置下,相较于有竞争力的基线方法,在新视角合成和不确定性估计方面均有提升。
英文摘要:
Neural radiance fields (NeRFs) have gained popularity with multiple works showing promising results across various applications. However, to the best of our knowledge, existing works do not explicitly model the distribution of training camera poses, or consequently the triangulation quality, a key factor affecting reconstruction quality dating back to classical vision literature. We close this gap with ProvNeRF, an approach that models the \textbf{provenance} for each point -- i.e., the locations where it is likely visible -- of NeRFs as a stochastic field. We achieve this by extending implicit maximum likelihood estimation (IMLE) to functional space with an optimizable objective. We show that modeling per-point provenance during the NeRF optimization enriches the model with information on triangulation leading to improvements in novel view synthesis and uncertainty estimation under the challenging sparse, unconstrained view setting against competitive baselines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。