The recent advent of 3D Gaussian Splatting (3DGS) has revolutionized the 3D scene reconstruction space enabling high-fidelity novel view synthesis in real-time. However, with the exception of RawNeRF, all prior 3DGS and NeRF-based methods rely on 8-bit tone-mapped Low Dynamic Range (LDR) images for scene reconstruction. Such methods struggle to achieve accurate reconstructions in scenes that require a higher dynamic range. Examples include scenes captured in nighttime or poorly lit indoor spaces having a low signal-to-noise ratio, as well as daylight scenes with shadow regions exhibiting extreme contrast. Our proposed method HDRSplat tailors 3DGS to train directly on 14-bit linear raw images in near darkness which preserves the scenes' full dynamic range and content. Our key contributions are two-fold: Firstly, we propose a linear HDR space-suited loss that effectively extracts scene information from noisy dark regions and nearly saturated bright regions simultaneously, while also handling view-dependent colors without increasing the degree of spherical harmonics. Secondly, through careful rasterization tuning, we implicitly overcome the heavy reliance and sensitivity of 3DGS on point cloud initialization. This is critical for accurate reconstruction in regions of low texture, high depth of field, and low illumination. HDRSplat is the fastest method to date that does 14-bit (HDR) 3D scene reconstruction in $\le$15 minutes/scene ($\sim$30x faster than prior state-of-the-art RawNeRF). It also boasts the fastest inference speed at $\ge$120fps. We further demonstrate the applicability of our HDR scene reconstruction by showcasing various applications like synthetic defocus, dense depth map extraction, and post-capture control of exposure, tone-mapping and view-point.
ClearGS: Reliability-Aware Gaussian Splatting from Handheld Videos
Shenzhen University of Advanced Technology(深圳理工大学);HONOR(荣耀);University of New South Wales(新南威尔士大学);Southern University of Science and Technology(南方科技大学)
Wangxuan Institute of Computer Technology, Peking University(北京大学计算机技术研究院);Chongqing Changan Automobile Co., Ltd(重庆长安汽车有限公司);University of California, Merced(加州大学默塞德分校)
EOGS++: Earth Observation Gaussian Splatting with Internal Camera Refinement and Direct Panchromatic Rendering
Universite Paris-Saclay, CNRS, ENS Paris-Saclay, Centre Borelli(巴黎萨克雷大学,法国国家科学研究中心,巴黎萨克雷高等师范学校,博雷利中心);Politecnico di Torino(都灵理工大学);AMIAD, Pôle Recherche(AMIAD,研究部);Institut Universitaire de France(法兰西大学研究院)
Rad-GS: Radar-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environments
Department of Automation, School of Mechanical Engineering and Automation, Harbin Institute of Technology(自动化系、机械工程与自动化学院、哈尔滨工业大学);School of Computer Science and Technology, Harbin Institute of Technology(计算机科学与技术学院、哈尔滨工业大学)
SurgCalib: Gaussian Splatting-Based Hand-Eye Calibration for Robot-Assisted Minimally Invasive Surgery
Robotics and Control Laboratory, University of British Columbia(机器人与控制实验室,不列颠哥伦比亚大学);Department of Biomedical Engineering, National University of Singapore(生物医学工程系,新加坡国立大学);Division of Otolaryngology – Head and Neck Surgery, University of British Columbia(耳鼻喉科–头颈外科部,不列颠哥伦比亚大学)
EvGGS: A Collaborative Learning Framework for Event-based Generalizable Gaussian Splatting
Function Hub, Hong Kong University of Science and Technology(香港科技大学(广州)功能中心);Faculty of Robot Science and Engineering, Northeastern University(东北大学机器人科学与工程学院)
Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting
Department of Computer Science, State University of New York(计算机科学系,纽约州立大学);Department of Mechanical Engineering, State University of New York(机械工程系,纽约州立大学)
Learning human-to-robot handovers through 3D scene reconstruction
Centre for Intelligent Sensing, Queen Mary University of London(智能感知中心,伦敦女王玛丽大学);Idiap Research Institute and École Polytechnique Fédérale de Lausanne(Idiap研究机构和瑞士洛桑联邦理工学院)
LL-Gaussian: Low-Light Scene Reconstruction and Enhancement via Gaussian Splatting for Novel View Synthesis
Zhejiang Lab(浙江实验室);University of Chinese Academy of Sciences(中国科学院大学);State Key Lab of CAD&CG, Zhejiang University(浙江大学计算机辅助设计与图形学国家重点实验室);Simon Fraser University(Simon Fraser大学);Hangzhou Dianzi University(杭州电子科技大学)
Federated 3D Gaussian Splatting for Large-Scale Scene Reconstruction at Wireless Edge
The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Shenzhen Future Network of Intelligence Institute(深圳未来智能网络研究院);Guangdong Provincial Key Laboratory of Future Networks of Intelligence(广东省未来智能网络重点实验室);University of Liverpool(利物浦大学);University of Science and Technology of China(中国科学技术大学);Beijing Institute of Technology(北京理工大学)
IXGS-Intraoperative 3D Reconstruction from Sparse, Arbitrarily Posed Real X-rays
Research in Orthopedic Computer Science, Balgrist University Hospital, Zurich, 8008, Switzerland(骨科计算机科学研究所,巴尔格里斯大学医院,苏黎世,8008,瑞士);The Australian National University, Canberra, ACT 2601, Australia(澳大利亚国立大学,堪培拉,ACT 2601,澳大利亚);Department of Orthopedics, Balgrist University Hospital, University of Zurich, Zurich, 8008, Switzerland(骨科系,巴尔格里斯大学医院,苏黎世大学,苏黎世,8008,瑞士)
Toward Human-Robot Teaming: Learning Handover Behaviors from 3D Scenes
Centre for Intelligent Sensing, Queen Mary University of London(智能感知中心,伦敦女王玛丽大学);Idiap Research Institute and École Polytechnique Fédérale de Lausanne(IDiap研究机构和日内瓦联邦理工学院)
The Oxford Spires Dataset: Benchmarking Large-Scale LiDAR-Visual Localisation, Reconstruction and Radiance Field Methods
Oxford Robotics Inst., Dept. of Eng. Science, Univ. of Oxford, UK(牛津大学机器人研究所、工程科学系);Group of Automation, Robotics and Computer Vision (AUROVA), University of Alicante, Spain(自动化、机器人与计算机视觉小组(AUROVA)、阿尔基兰特大学)
Learning Physics-Grounded 4D Dynamics with Neural Gaussian Force Fields
Institute for AI, Peking University(北京大学人工智能研究院);School of Psychological and Cognitive Sciences, Peking University(北京大学心理学与认知科学学院);School of EECS, Peking University(北京大学电子工程学院);Department of Automation, Tsinghua University(清华大学自动化系);Yuanpei College, Peking University(北京大学元培学院);State Key Lab of General AI, Peking University(北京大学通用人工智能国家重点实验室);Beijing Key Laboratory of Behavior and Mental Health, Peking University(北京行为与心理健康重点实验室)
CE-NPBG: Connectivity Enhanced Neural Point-Based Graphics for Novel View Synthesis in Autonomous Driving Scenes
Computer Vision Center (CVC), Universitat Autònoma de Barcelona(计算机视觉中心(CVC),巴塞罗那自治大学);Intelligent Simulation Innovation Lab, Huawei Munich Research Center(智能仿真创新实验室,华为慕尼黑研究中心)