In this paper, we tackle the problem of dense light field (LF) reconstruction from sparsely-sampled ones with wide baselines and propose a learnable model, namely dynamic interpolation, to replace the commonly-used geometry warping operation. Specifically, with the estimated geometric relation between input views, we first construct a lightweight neural network to dynamically learn weights for interpolating neighbouring pixels from input views to synthesize each pixel of novel views independently. In contrast to the fixed and content-independent weights employed in the geometry warping operation, the learned interpolation weights implicitly incorporate the correspondences between the source and novel views and adapt to different image content information. Then, we recover the spatial correlation between the independently synthesized pixels of each novel view by referring to that of input views using a geometry-based spatial refinement module. We also constrain the angular correlation between the novel views through a disparity-oriented LF structure loss. Experimental results on LF datasets with wide baselines show that the reconstructed LFs achieve much higher PSNR/SSIM and preserve the LF parallax structure better than state-of-the-art methods. The source code is publicly available at https://github.com/MantangGuo/DI4SLF.
Plug-and-Play Priors for Bright Field Electron Tomography and Sparse Interpolation
Purdue University(普渡大学);Lawrence Berkeley National Laboratory(劳伦斯伯克利国家实验室);Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Air Force Research Laboratory(美国空军研究实验室)
Enhancing Novel View Synthesis from extremely sparse views with SfM-free 3D Gaussian Splatting Framework
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University(电子与电气工程系,香港理工大学);School of Intelligent Systems Engineering, Sun Yat-sen University(智能系统工程学院,中山大学)
Deep Depth Completion from Extremely Sparse Data: A Survey
Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院);Samsung Research(三星研究院);South China Normal University(华南师范大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
Latent Interpolation Learning Using Diffusion Models for Cardiac Volume Reconstruction
School of Computation, Information and Technology, Technical University Munich(技术大学慕尼黑计算信息学院);Munich Center for Machine Learning(慕尼黑机器学习中心);Department of Quantitative Biomedicine, University of Zurich(苏黎世大学定量生物医学系);Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford(牛津大学生物医学工程研究所);Imperial College London(伦敦帝国学院);University of Sheffield(谢菲尔德大学);NVIDIA(英伟达);Department of Computing, Imperial College London(伦敦帝国学院计算机系);Department AIBE of Friedrich-Alexander-Universität Erlangen-Nürnberg(埃尔兰根-纽伦堡大学AIBE系);School of Medicine, Klinikum Rechts der Isar, Technical University of Munich(慕尼黑技术大学医学院,莱纳特医院)
Visual Spatial Learning: Single-Field Spatial Interpolation Using Convolutional Neural Networks
Centro de Matemática (CMAT), Universidade do Minho(数学中心(CMAT),明霍大学);DEI-FEUP & INESC TEC, Universidade do Porto(FEUP-DEI与INESC TEC,波尔图大学);Instituto Português do Mar e da Atmosfera, I. P. (IPMA, I. P.), Lisboa, Portugal(葡萄牙海洋与大气研究所(IPMA, I. P.),里斯本,葡萄牙);Centro de Ciências do Mar e do Ambiente (MARE), Évora, Portugal(海洋与环境科学中心(MARE),埃维拉,葡萄牙)