Neural radiance fields (NeRF) and 3D Gaussian Splatting (3DGS) are popular techniques to reconstruct and render photo-realistic images. However, the pre-requisite of running Structure-from-Motion (SfM) to get camera poses limits their completeness. While previous methods can reconstruct from a few unposed images, they are not applicable when images are unordered or densely captured. In this work, we propose ZeroGS to train 3DGS from hundreds of unposed and unordered images. Our method leverages a pretrained foundation model as the neural scene representation. Since the accuracy of the predicted pointmaps does not suffice for accurate image registration and high-fidelity image rendering, we propose to mitigate the issue by initializing and finetuning the pretrained model from a seed image. Images are then progressively registered and added to the training buffer, which is further used to train the model. We also propose to refine the camera poses and pointmaps by minimizing a point-to-camera ray consistency loss across multiple views. Experiments on the LLFF dataset, the MipNeRF360 dataset, and the Tanks-and-Temples dataset show that our method recovers more accurate camera poses than state-of-the-art pose-free NeRF/3DGS methods, and even renders higher quality images than 3DGS with COLMAP poses. Our project page is available at https://aibluefisher.github.io/ZeroGS.
DynSUP: Dynamic Gaussian Splatting from An Unposed Image Pair
Technical University of Munich（慕尼黑工业大学）；Munich Center for Machine Learning（慕尼黑机器学习中心）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））
EvTrajGS: Accurate and Efficient 3D Gaussian Splatting from Unposed Event Streams
School of Computer Science and Engineering, Sun Yat-sen University（中山大学计算机科学与工程学院）；Guangdong Province Key Laboratory of Information Security Technology（广东省信息安全技术重点实验室）；Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education（机器智能与先进计算教育部重点实验室）；College of Computing and Data Science, Nanyang Technological University（南洋理工大学计算与数据科学学院）；School of Computing and Information Technology, Great Bay University（大湾区大学计算与信息技术学院）
Pose-Free Omnidirectional Gaussian Splatting for 360-Degree Videos with Consistent Depth Priors
School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Chongqing University（重庆大学）；Air Force Engineering University（空军工程大学）
GrapeSplat: Geometry-Grounded Reconstruction via Amalgamated Pose-Free Encoding for Feed-Forward 3D Gaussian Splatting
National Taiwan University（国立台湾大学）；National Taiwan University of Science and Technology（国立台湾科技大学）；NTU AI Center of Research Excellence (NTU AI-CoRE)（台湾大学人工智能卓越研究中心）；VinUniversity（Vin大学）
TokenSplat: Token-aligned 3D Gaussian Splatting for Feed-forward Pose-free Reconstruction
State Key Laboratory of Complex and Critical Software Environment（复杂与关键软件环境国家重点实验室）；School of Computer Science and Engineering（计算机科学与工程学院）；School of Artificial Intelligence（人工智能学院）
GroupForward: Building Referable 3D Scenes via Instance-Grouped Feed-Forward Gaussian Splatting
School of Computer Science, Shanghai Jiao Tong University（上海交通大学计算机科学学院）；School of Computer Science and Engineering, Beihang University（北京航空航天大学计算机科学与工程学院）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；School of Computer Science and Technology, East China Normal University（华东师范大学计算机科学与技术学院）
SaLon3R: Structure-aware Long-term Generalizable 3D Reconstruction from Unposed Images
The Chinese University of Hong Kong（香港中文大学）；Hong Kong Center for Logistics Robotics（香港物流机器人中心）；University of California, Berkeley（加州大学伯克利分校）；Zhejiang University（浙江大学）
PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splatting
The Hong Kong University of Science and Technology（香港科技大学）；Ant Group（蚂蚁集团）；Wuhan University（武汉大学）；Zhejiang University（浙江大学）；The Pennsylvania State University（宾夕法尼亚州立大学）
GBR: Generative Bundle Refinement for High-fidelity Gaussian Splatting with Enhanced Mesh Reconstruction
College of future information technology, Fudan University（未来信息科技学院，复旦大学）；School of Biomedical Engineering, Tsinghua University（生物医学工程学院，清华大学）；Key Laboratory for Information Science of Electromagnetic Waves (MoE), Fudan University（电磁波信息科学重点实验室（MoE），复旦大学）；Department of Automation, Tsinghua University（自动化系，清华大学）；MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University（人工智能重点实验室，人工智能研究院，上海交通大学）
ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare
University of California Merced（加州大学默塞德分校）；ETH Zurich（苏黎世联邦理工学院）；NVIDIA；Shanghai Jiao Tong University（上海交通大学）；Hong Kong University of Science and Technology（香港科技大学）
Feat2GS: Probing Visual Foundation Models with Gaussian Splatting
Zhejiang University（浙江大学）；Westlake University（西湖大学）；Max Planck Institute for Informatics（马克斯·普朗克信息学研究所）；Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所）
Dental3R: Geometry-Aware Pairing for Intraoral 3D Reconstruction from Sparse-View Photographs
School of AI and Advanced Computing, Xi'an Jiaotong-Liverpool University, China（人工智能与先进计算学院，西安交通大学利物浦大学，中国）；School of Electrical Engineering, Electronics and Computer Science, University of Liverpool, United Kingdom（电子工程与计算机科学学院，利物浦大学，英国）；School of Advanced Technology, Xi'an Jiaotong-Liverpool University, China（先进技术学院，西安交通大学利物浦大学，中国）；School of Physical Sciences, University of Liverpool, Liverpool, United Kingdom（物理科学学院，利物浦大学，英国）；School of Mathematics and Physics, Xi'an Jiaotong-Liverpool University, China（数学与物理学院，西安交通大学利物浦大学，中国）；Institute of Artificial Intelligence Innovation, Zhejiang University of Technology, China（人工智能创新研究院，浙江工业大学，中国）
