This survey aims to investigate fundamental deep learning (DL) based 3D reconstruction techniques that produce photo-realistic 3D models and scenes, highlighting Neural Radiance Fields (NeRFs), Latent Diffusion Models (LDM), and 3D Gaussian Splatting. We dissect the underlying algorithms, evaluate their strengths and tradeoffs, and project future research trajectories in this rapidly evolving field. We provide a comprehensive overview of the fundamental in DL-driven 3D scene reconstruction, offering insights into their potential applications and limitations.
Advances in Feed-Forward 3D Reconstruction and View Synthesis: A Survey
NTU(国立台湾大学);Caltech(加州理工学院);Westlake University(西湖大学);UCSD(加州大学圣地亚哥分校);University of Oxford(牛津大学);Nanjing University(南京大学);HKU(香港大学);University of Cambridge(剑桥大学);Hillbot;MPI for Informatics(信息研究所);Harvard University(哈佛大学);MIT(麻省理工学院)
A Survey on 3D Reconstruction Techniques in Plant Phenotyping: From Classical Methods to Neural Radiance Fields (NeRF), 3D Gaussian Splatting (3DGS), and Beyond
Department of Electrical and Computer Engineering, Michigan State University(电气与计算机工程系,密歇根州立大学);Department of Systems and Information Engineering & Link Lab, University of Virginia(系统与信息工程系及Link实验室,弗吉尼亚大学);Department of Statistics and Probability, Michigan State University(统计与概率系,密歇根州立大学);School of Chemistry, Chemical Engineering and Biotechnology, Nanyang Technological University(化学、化工与生物技术学院,南洋理工大学);Department of Agricultural and Biological Engineering, Mississippi State University(农业与生物工程系,密西西比州立大学);Department of Mechanical Engineering, Michigan State University(机械工程系,密歇根州立大学)
Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era
Southwest University(西南大学);Tianjin University(天津大学);University of Western Australia(西澳大学);Murdoch University(莫道克大学);University of South Australia(南澳大学)
UAV3DCrop: Benchmarking 3D Reconstruction in Repeated Multi-Angle UAV Crop Surveys
University of Minnesota, Twin Cities(明尼苏达大学双城校区);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);University of Pittsburgh(匹兹堡大学);Max Planck Institute for Biogeochemistry(马克斯·普朗克生物地球化学研究所);Boston University(波士顿大学);Peking University(北京大学)
A Comprehensive Survey on Magnetic Resonance Image Reconstruction
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Big Data Institute, Central South University(中南大学大数据研究院);Shenzhen Institute of Advanced Technology, Chinese Academy of Science(中国科学院深圳先进技术研究院)
Reconstruction of Complex-Valued Fractional Brownian Motion Fields Based on Compressive Sampling and Its Application to PSF Interpolation in Weak Lensing Survey
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Shandong University(山东大学)
Natural Image Reconstruction from fMRI using Deep Learning: A Survey
Tokyo Institute of Technology(东京工业大学);National Institute of Advanced Industrial Science and Technology(产业技术综合研究所);AIST-Tokyo Tech Real World Big-Data Computation Open Innovation Laboratory(AIST-东京工业大学真实世界大数据计算开放创新实验室)
A survey on computational spectral reconstruction methods from RGB to hyperspectral imaging
University of Chinese Academy of Sciences(中国科学院大学);Xidian University(西安电子科技大学);King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Princeton University(普林斯顿大学);Vrije Universiteit Brussel(布鲁塞尔自由大学)
Learning-based 3D Reconstruction in Autonomous Driving: A Comprehensive Survey
Global Institute of Future Technology, Shanghai Jiao Tong University(未来技术全球研究院,上海交通大学);School of Automation and Intelligent Sensing, Shanghai Jiao Tong University(自动化与智能感知学院,上海交通大学);Department of Electrical Engineering, University of Texas at Arlington(电气工程系,德克萨斯理工大学)
S-Lab, College of Computing and Data Science, Nanyang Technological University(S实验室,计算与数据科学学院,南洋理工大学);Intelligent Graphics Lab, The Hong Kong University of Science and Technology(智能图形实验室,香港科学与技术大学)
Learned reconstruction methods with convergence guarantees
University College London(伦敦大学学院);KTH–Royal Institute of Technology(KTH皇家理工学院);Maxwell Institute for Mathematical Sciences(麦克斯韦数学科学研究所);Heriot-Watt University(赫瑞-瓦特大学);University of Cambridge(剑桥大学);University of Oulu(奥卢大学)