3D Gaussian Splatting(3DGS,三维高斯泼溅)是近年兴起的一种创新高效的3D表征技术。尽管其在扩展现实(XR,extended reality)应用中的潜力被频繁提及,但实际有效性仍未得到充分探究。本研究考察了三种不同的基于3DGS的虚拟环境(VE,virtual environment)构建方法,利用其各自独特优势实现高效且视觉效果出色的场景表征。通过对比研究,我们评估了3DGS构建沉浸式VE的可行性,明确了其在XR应用中的局限性,并探讨了未来的研发方向。
英文摘要:
3D Gaussian Splatting (3DGS) has recently emerged as an innovative and efficient 3D representation technique. While its potential for extended reality (XR) applications is frequently highlighted, its practical effectiveness remains underexplored. In this work, we examine three distinct 3DGS-based approaches for virtual environment (VE) creation, leveraging their unique strengths for efficient and visually compelling scene representation. By conducting a comparable study, we evaluate the feasibility of 3DGS in creating immersive VEs, identify its limitations in XR applications, and discuss future research and development opportunities.
Comparative evaluation of photogrammetric reconstruction methods and 3D Gaussian Splatting for road surface roughness analysis
School of International Education, Hubei University of Technology(湖北工业大学国际教育学院);School of Computer Science, Hubei University of Technology(湖北工业大学计算机科学学院)
Rendering Anywhere You See: Renderability Field-guided Gaussian Splatting
Laboratory of Artificial Intelligence Robotics(人工智能机器人实验室);Politecnico di Milano(米兰理工学院);Ningbo Institute of Materials Technology and Engineering(宁波材料技术与工程研究所)
GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
University of Southern California(南加州大学);Google(谷歌);Pennsylvania State University(宾夕法尼亚州立大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Rendering Multi-Human and Multi-Object with 3D Gaussian Splatting
State Key Lab of CAD&CG, College of Computer Science, Zhejiang University(浙江大学计算机科学与技术学院计算机辅助设计与图形学国家重点实验室);Department of Computer Science and Engineering, The Hong Kong University of Science and Technology(香港科技大学计算机科学与工程系)
FieryGS: In-the-Wild Fire Synthesis with Physics-Integrated Gaussian Splatting
School of EECS, Peking University(电子工程系,北京大学);School of Intelligence Science and Technology, Peking University(智能科学与技术学院,北京大学);Yuanpei College, Peking University(元培学院,北京大学);ByteDance Seed(字节跳动种子);Wangxuan Institute of Computer Technology, Peking University(王璇计算机技术研究所,北京大学);Beijing Academy of Artificial Intelligence, Beijing, China(北京人工智能研究院,北京,中国)
MEGA: Memory-Efficient 4D Gaussian Splatting for Dynamic Scenes
iComAI Lab, The Hong Kong University of Science and Technology(香港科技大学iComAI实验室);Skywork AI;The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院)
ExtrinSplat: Decoupling Geometry and Semantics for Open-Vocabulary Understanding in 3D Gaussian Splatting
Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, Shenzhen Graduate School, Peking University(广东省超高清沉浸式媒体技术重点实验室,北京大学深圳研究生院);School of Computer Science and Technology, Tianjin University(天津大学计算机科学与技术学院);Guangdong Bohua UHD Innovation Center Co., Ltd.(广东博华超高清创新中心有限公司)
ReCoSplat: Online Feed-Forward Gaussian Splatting via Render-and-Compare
University of California Merced(加州大学默塞德分校);ETH Zurich(苏黎世联邦理工学院);NVIDIA;Shanghai Jiao Tong University(上海交通大学);Hong Kong University of Science and Technology(香港科技大学)
RePaintGS: Reference-Guided Gaussian Splatting for Realistic and View-Consistent 3D Scene Inpainting
Intelligence and Interaction Research Center, Korea Institute of Science and Technology(智能交互研究所,韩国科学技术院);Department of Computer Science and Engineering, Korea University(韩国大学计算机科学与工程系);AI-Robotics, KIST School, Korea National University of Science and Technology(人工智能机器人,KIST学院,韩国科学技术大学)
Transforming Omnidirectional RGB-LiDAR data into 3D Gaussian Splatting
Department of Computer Science, State University of New York(计算机科学系,纽约州立大学);Department of Mechanical Engineering, State University of New York(机械工程系,纽约州立大学)
SVGS: Single-View to 3D Object Editing via Gaussian Splatting
School of Computer Science and Technology, Zhejiang Gongshang University(浙江工商大学计算机科学与技术学院);Zhejiang Key Laboratory of Big Data and Future E-Commerce Technology(浙江省大数据与未来电子商务技术重点实验室);Jianpei Technology Co., Ltd.(建培科技有限公司);School of Artificial Intelligence and Computer Science, Nantong University(南通大学人工智能与计算机科学学院);Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University(沙特本·阿卜杜勒阿齐兹王子大学计算机工程与科学学院计算机科学系);Department of Computer Science, Faculty of Computers and Information, Qena University(基纳大学计算机与信息学院计算机科学系);Department of Computing Sciences, Faculty of Information Technology and Communication Sciences, Tampere University(坦佩雷大学信息技术与通信科学学院计算科学系);Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, The University of Hong Kong(香港大学牙医学院口腔颌面外科);Systems Research Institute of the Polish Academy of Sciences(波兰科学院系统研究所);AGH University of Krakow(AGH科技大学);SAN University(SAN大学)
SyncTalk++: High-Fidelity and Efficient Synchronized Talking Heads Synthesis Using Gaussian Splatting
School of Information, Renmin University of China(中国人民大学信息学院);School of Information and Communication Engineering, Beijing University of Posts and Telecommunications(北京邮电大学信息与通信工程学院);Aerospace Information Research Institute, Chinese Academy of Sciences(中国科学院航天信息研究所);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Institute for AI Industry Research, Tsinghua University(清华大学人工智能产业研究院);School of Economics and Management, Tsinghua University(清华大学经济管理学院);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院)
SEGA: Drivable 3D Gaussian Head Avatar from a Single Image
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);ByteDance(字节跳动);Pengcheng Lab(鹏城实验室);Department of Automation, Tsinghua University(清华大学自动化系)
NRGS-SLAM: Monocular Non-Rigid SLAM for Endoscopy via Deformation-Aware 3D Gaussian Splatting
Department of Mechanical and Automation Engineering and T Stone Robotics Institute, The Chinese University of Hong Kong(机械与自动化工程系和T Stone机器人研究所,香港中文大学);School of Automation and Intelligent Sensing, the State Key Laboratory of Avionics Integration and Aviation System of-Systems Synthesis, and Shanghai Key Laboratory of Navigation and Location Based Services, Shanghai Jiao Tong University(自动化与智能感知学院、航空系统集成与航空系统综合国家重点实验室、上海导航与定位服务重点实验室,上海交通大学)
GS-ROR$^2$: Bidirectional-guided 3DGS and SDF for Reflective Object Relighting and Reconstruction
VCIP, College of Computer Science, Nankai University(VCIP,计算机科学学院,南开大学);School of Intelligence Science and Technology, Nanjing University(智能科学与技术学校,南京大学)
Comparative Analysis of Novel View Synthesis and Photogrammetry for 3D Forest Stand Reconstruction and extraction of individual tree parameters
Fuzhou University(福州大学);National Engineering Research Center of Geospatial Information Technology(国家地理空间信息技术工程研究中心);Key Laboratory of Spatial Data Mining and Information Sharing of Ministry of Education(教育部空间数据挖掘与信息共享重点实验室);The Academy of Digital China (Fujian)(数字中国研究院(福建))