arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.04437cs.CVastro-ph.CO
收藏

基于神经场的单视角折射率层析成像

Single View Refractive Index Tomography with Neural Fields

California Institute of Technology(加州理工学院);Google Research(谷歌研究院)

Brandon Zhao, Aviad Levis, Liam Connor, Pratul P. Srinivasan, Katherine L. Bouman

AI总结:

本文提出一种基于神经场和可微光线追踪的单视角折射率层析成像方法,利用介质内光源先验从单张图像重建三维折射场,并在模拟折射场和暗物质映射任务中验证了有效性。

摘要:

折射率层析成像是一个逆问题,旨在利用二维投影图像测量重建场景中连续变化的三维折射率。虽然纯折射场本身不可直接观测,但它会使光线在空间中传播时发生弯曲,从而为重建提供信号。这类场的效应出现在许多科学计算机视觉场景中,从显微镜下透明细胞引起的折射,到天体物理学中暗物质导致的遥远星系透镜效应。由于折射场对观测图像具有复杂的非线性影响,重建这些场尤其困难。此外,标准三维重建和层析成像设置通常可以从多个视角观测场景,但许多折射率层析成像问题只能获得单一视角下观测到的图像。我们提出一种方法,利用分布在折射介质中的光源先验知识来帮助消除单视角折射率层析成像问题的歧义。我们通过折射场的神经场表示对弯曲光线进行可微追踪,并优化其参数以最好地重现观测图像。我们通过重建模拟折射场验证了方法的有效性,分析了光源分布对恢复场的影响,并在模拟暗物质映射问题上测试了我们的方法,成功恢复了由真实暗物质分布引起的三维折射场。

英文摘要:

Refractive Index Tomography is the inverse problem of reconstructing the continuously-varying 3D refractive index in a scene using 2D projected image measurements. Although a purely refractive field is not directly visible, it bends light rays as they travel through space, thus providing a signal for reconstruction. The effects of such fields appear in many scientific computer vision settings, ranging from refraction due to transparent cells in microscopy to the lensing of distant galaxies caused by dark matter in astrophysics. Reconstructing these fields is particularly difficult due to the complex nonlinear effects of the refractive field on observed images. Furthermore, while standard 3D reconstruction and tomography settings typically have access to observations of the scene from many viewpoints, many refractive index tomography problem settings only have access to images observed from a single viewpoint. We introduce a method that leverages prior knowledge of light sources scattered throughout the refractive medium to help disambiguate the single-view refractive index tomography problem. We differentiably trace curved rays through a neural field representation of the refractive field, and optimize its parameters to best reproduce the observed image. We demonstrate the efficacy of our approach by reconstructing simulated refractive fields, analyze the effects of light source distribution on the recovered field, and test our method on a simulated dark matter mapping problem where we successfully recover the 3D refractive field caused by a realistic dark matter distribution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑