arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.09877cs.CV
收藏

多视卫星摄影测量的阴影神经辐射场

Shadow Neural Radiance Fields for Multi-view Satellite Photogrammetry

European Space Agency - ESTEC(欧洲空间局-欧洲空间研究和技术中心)

Dawa Derksen, Dario Izzo

摘要:

我们提出了一种新的通用方法,用于对地观测场景的阴影感知多视图卫星摄影测量。我们提出的方法,阴影神经辐射场(S-NeRF)遵循隐式体积表示学习的最新进展。对于每个场景,我们使用从已知视角拍摄的非常高的空间分辨率的光学图像来训练S-NeRF。学习不需要标签或形状先验:它是由图像重建损失自我监督的。为了适应来自定向光源(太阳)和漫射光源(天空)的不断变化的光源条件,我们以两种方式扩展了NeRF方法。首先,通过局部光源可见度场对来自太阳的直接照明进行建模。其次,来自漫射光源的间接照明被学习为作为太阳位置的函数的非局部色场。定量地说,这些因素的组合减少了阴影区域中的高度和颜色误差,与NeRF相比。S-NeRF方法不仅可以执行新的视图合成和全3D形状估计,还可以实现阴影检测、阴影合成和瞬态对象过滤,而无需任何显式形状监督。

英文摘要:

We present a new generic method for shadow-aware multi-view satellite photogrammetry of Earth Observation scenes. Our proposed method, the Shadow Neural Radiance Field (S-NeRF) follows recent advances in implicit volumetric representation learning. For each scene, we train S-NeRF using very high spatial resolution optical images taken from known viewing angles. The learning requires no labels or shape priors: it is self-supervised by an image reconstruction loss. To accommodate for changing light source conditions both from a directional light source (the Sun) and a diffuse light source (the sky), we extend the NeRF approach in two ways. First, direct illumination from the Sun is modeled via a local light source visibility field. Second, indirect illumination from a diffuse light source is learned as a non-local color field as a function of the position of the Sun. Quantitatively, the combination of these factors reduces the altitude and color errors in shaded areas, compared to NeRF. The S-NeRF methodology not only performs novel view synthesis and full 3D shape estimation, it also enables shadow detection, albedo synthesis, and transient object filtering, without any explicit shape supervision.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑