Decoupling lighting from geometry using unconstrained photo collections is notoriously challenging. Solving it would benefit many users as creating complex 3D assets takes days of manual labor. Many previous works have attempted to address this issue, often at the expense of output fidelity, which questions the practicality of such methods. We introduce LumiGauss - a technique that tackles 3D reconstruction of scenes and environmental lighting through 2D Gaussian Splatting. Our approach yields high-quality scene reconstructions and enables realistic lighting synthesis under novel environment maps. We also propose a method for enhancing the quality of shadows, common in outdoor scenes, by exploiting spherical harmonics properties. Our approach facilitates seamless integration with game engines and enables the use of fast precomputed radiance transfer. We validate our method on the NeRF-OSR dataset, demonstrating superior performance over baseline methods. Moreover, LumiGauss can synthesize realistic images for unseen environment maps. Our code: https://github.com/joaxkal/lumigauss.
ROSGS: Relightable Outdoor Scenes With Gaussian Splatting
School of Information Science and Technology, North China University of Technology(信息科学与技术学院,中国北方工业大学);Beijing Key Laboratory of Mobile Computing and Pervasive Device, Institute of Computing Technology, Chinese Academy of Sciences(移动计算与普适设备北京市重点实验室,中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);School of Computer Science and Informatics, Cardiff University(计算机科学与信息学院,卡迪夫大学)
PR-ENDO: Physically Based Relightable Gaussian Splatting for Endoscopy
Sano Centre for Computional Medicine, Poland(波兰萨诺计算医学中心);Warsaw University of Technology, Poland(波兰华沙理工大学);Doctoral School of Exact and Natural Sciences, Jagiellonian University, Poland(杰齐尔大学精确与自然科学博士学院);Faculty of Mathematics and Computer Science, Jagiellonian University, Poland(杰齐尔大学数学与计算机科学学院);University of Verona, Italy(意大利威尼斯大学);IDEAS Research Institute, Poland(波兰IDEAS研究所)
R-PGA: Robust Physical Adversarial Camouflage Generation via Relightable 3D Gaussian Splatting
School of Cyber Science and Technology, Shenzhen Campus, Sun Yat-sen University(中山大学深圳校区网络空间安全学院);School of Computing, National University of Singapore(新加坡国立大学计算机学院);School of Intelligent Systems Engineering, Shenzhen Campus, Sun Yat-sen University(中山大学深圳校区智能工程学院)
Large Material Gaussian Model for Relightable 3D Generation
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);The University of Hong Kong(香港大学);LIGHTSPEED;The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
HRAvatar: High-Quality and Relightable Gaussian Head Avatar
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院,清华大学);International Digital Economy Academy (IDEA) Intern(国际数字经济发展学院(IDEA)实习生)
Interactive Rendering of Relightable and Animatable Gaussian Avatars
State Key Lab of CAD & CG, Zhejiang University(浙江大学计算机辅助设计与图形学国家重点实验室);UCL Centre for Artificial Intelligence, Department of Computer Science, University College London(伦敦大学学院计算机科学系人工智能中心);Kahlert School of Computing, University of Utah(犹他大学Kahlert计算学院)
MedGS: Gaussian Splatting for Multi-Modal 3D Medical Imaging
Jagiellonian University, Poland(雅盖隆大学,波兰);Warsaw University of Technology, Poland(华沙理工大学,波兰);IDEAS Research Institute, Poland(IDEAS研究所,波兰);Military Institute of Medicine, Poland(军事医学研究所,波兰)
GS-ROR$^2$: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstruction
VCIP, College of Computer Science, Nankai University(VCIP,计算机科学学院,南开大学);School of Intelligence Science and Technology, Nanjing University(智能科学与技术学校,南京大学)