Reconstructing and rendering 3D objects from highly sparse views is of critical importance for promoting applications of 3D vision techniques and improving user experience. However, images from sparse views only contain very limited 3D information, leading to two significant challenges: 1) Difficulty in building multi-view consistency as images for matching are too few; 2) Partially omitted or highly compressed object information as view coverage is insufficient. To tackle these challenges, we propose GaussianObject, a framework to represent and render the 3D object with Gaussian splatting that achieves high rendering quality with only 4 input images. We first introduce techniques of visual hull and floater elimination, which explicitly inject structure priors into the initial optimization process to help build multi-view consistency, yielding a coarse 3D Gaussian representation. Then we construct a Gaussian repair model based on diffusion models to supplement the omitted object information, where Gaussians are further refined. We design a self-generating strategy to obtain image pairs for training the repair model. We further design a COLMAP-free variant, where pre-given accurate camera poses are not required, which achieves competitive quality and facilitates wider applications. GaussianObject is evaluated on several challenging datasets, including MipNeRF360, OmniObject3D, OpenIllumination, and our-collected unposed images, achieving superior performance from only four views and significantly outperforming previous SOTA methods. Our demo is available at https://gaussianobject.github.io/, and the code has been released at https://github.com/GaussianObject/GaussianObject.
LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstruction
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Futurewei Technologies Inc(未来科技公司);School of Computer and Information Sciences, The University of Newcastle(计算机与信息科学学院,新castle大学)
OccluGaussian: Occlusion-Aware Gaussian Splatting for Large Scene Reconstruction and Rendering
Huawei Noah’s Ark Lab(华为诺亚实验室);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Shenzhen Institutes of Advanced Technology(深圳先进技术研究院);The University of Hong Kong(香港大学);Huawei Embodied Intelligence Lab(华为具身智能实验室)
A Mixed-Primitive-based Gaussian Splatting Method for Surface Reconstruction
Lancaster University, United Kingdom(兰卡斯特大学,英国);The University of Queensland, Australia(昆士兰大学,澳大利亚);The Hong Kong Polytechnic University, China(香港理工大学,中国);University at Buffalo, United States of America(布法罗大学,美国)
PolGS: Polarimetric Gaussian Splatting for Fast Reflective Surface Reconstruction
Beijing University of Posts and Telecommunications(北京邮电大学);Xiong’an Aerospace Information Research Institute(雄安航空航天信息研究所);State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(信息处理国家重点实验室,北京大学计算机学院);National Engineering Research Center of Visual Technology, School of Computer Science, Peking University(视觉技术国家工程研究中心,北京大学计算机学院)
GauSS-MI: Gaussian Splatting Shannon Mutual Information for Active 3D Reconstruction
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Division of Robotics, Perception, and Learning, KTH Royal Institute of Technology(机器人、感知与学习 division,皇家理工学院);Faculty of Engineering, The University of Hong Kong(工程学院,香港大学);Centre for Transformative Garment Production, Hong Kong SAR, China(变革性服装生产中心,香港特别行政区,中国)
SolidGS: Consolidating Gaussian Surfel Splatting for Sparse-View Surface Reconstruction
Texas A&M University(德克萨斯农工大学);OPPO US Research Center(OPPO美国研究中心);Nanyang Technological University(南洋理工大学);Hong Kong University of Science and Technology(香港科技大学);The University of Hong Kong(香港大学)
SurgicalGS: Dynamic 3D Gaussian Splatting for Accurate Robotic-Assisted Surgical Scene Reconstruction
The Hamlyn Centre for Robotic Surgery, Imperial College London(伦敦帝国理工学院哈姆林 robotic外科中心);Hawkes Institute, University College London(伦敦大学学院霍克斯研究所);University of Liverpool(利物浦大学)
LGDWT-GS: Local and Global Discrete Wavelet-Regularized 3D Gaussian Splatting for Sparse-View Scene Reconstruction
National Institute of Standards and Technology(国家标准与技术研究院);Department of Physics, Colorado State University(科罗拉多州立大学物理系);Electrical Engineering Department, University of Colorado(科罗拉多大学电气工程系)
DGNS: Deformable Gaussian Splatting and Dynamic Neural Surface for Monocular Dynamic 3D Reconstruction
Industrial Research Organisation, Canberra, ACT Australia;College of Engineering Computing \& Cybernetics, The Australian National University, Canberra, ACT Australia;Faculty of Engineering, The University of Hong Kong, Hong Kong SAR China;Industrial Research Organisation;College of Engineering Computing \& Cybernetics, The Australian National University;Faculty of Engineering, The University of Hong Kong
GSurf: Learning Signed Distance Fields from Splatting Opaque Gaussians for High-quality 3D Reconstruction
College of Computing and Data Science, Nanyang Technological University(南洋理工大学计算与数据科学学院);School of Software, Dalian University of Technology(大连理工大学软件学院)
3D Gaussian Splatting for Large-scale Surface Reconstruction from Aerial Images
School of Remote Sensing and Information Engineering, Wuhan University(武汉大学遥感信息工程学院);School of Communication Engineering, Hangzhou Dianzi University(杭州电子科技大学通信工程学院)
Revisiting Photometric Ambiguity for Accurate Gaussian-Splatting Surface Reconstruction
School of Computer Science;Engineering, State Key Laboratory of Complex Critical \& Software Environment, Jiangxi Research Institute, Beihang University;State Key Laboratory of Virtual Reality Technology;Macquarie University;Tohoku University;School of Computing, National University of Singapore
RGBDS-SLAM: A RGB-D Semantic Dense SLAM Based on 3D Multi Level Pyramid Gaussian Splatting
Institute of Robotics and Automatic Information System, Nankai University(南开大学机器人与自动信息系统研究所);Tianjin Key Laboratory of Intelligent Robotics(天津市智能机器人重点实验室);TBI center, Nankai University(南开大学TBI中心)
Seeing Through Reflections: Advancing 3D Scene Reconstruction in Mirror-Containing Environments with Gaussian Splatting
School of Automation and Intelligent Sening, Shanghai Jiao Tong University(自动化与智能传感学院,上海交通大学);Ningbo Artificial Intelligence Institute, Shanghai Jiao Tong University(宁波人工智能研究所,上海交通大学)