Existing offline feed-forward methods for joint scene understanding and reconstruction on long image streams often repeatedly perform global computation over an ever-growing set of past observations, causing runtime and GPU memory to increase rapidly with sequence length and limiting scalability. We propose Streaming Semantic Gaussian Splatting (S2GS), a strictly causal, incremental 3D Gaussian semantic field framework: it does not leverage future frames and continuously updates scene geometry, appearance, and instance-level semantics without reprocessing historical frames, enabling scalable online joint reconstruction and understanding. S2GS adopts a geometry-semantic decoupled dual-backbone design: the geometry branch performs causal modeling to drive incremental Gaussian updates, while the semantic branch leverages a 2D foundation vision model and a query-driven decoder to predict segmentation masks and identity embeddings, further stabilized by query-level contrastive alignment and lightweight online association with an instance memory. Experiments show that S2GS matches or outperforms strong offline baselines on joint reconstruction-and-understanding benchmarks, while significantly improving long-horizon scalability: it processes 1,000+ frames with much slower growth in runtime and GPU memory, whereas offline global-processing baselines typically run out of memory at around 80 frames under the same setting.
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发式智能感知与认知联合实验室,中国科学技术大学);University of Missouri, Kansas City(密苏里大学,堪萨斯城)
AquaFlow: A Monocular Gaussian Splatting SLAM for Underwater Streaming Reconstruction
Zhejiang University(浙江大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Tsinghua University(清华大学);The University of Hong Kong(香港大学);The Chinese University of Hong Kong(香港中文大学)
Scale-GS: Efficient Scalable Gaussian Splatting via Redundancy-filtering Training on Streaming Content
School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院);Key Laboratory of Social Computing and Cognitive Intelligence (Dalian University of Technology), Ministry of Education(社会科学与认知智能重点实验室(大连理工大学));Department of Automation, Tsinghua University(清华大学自动化系)
GSStream: 3D Gaussian Splatting based Volumetric Scene Streaming System
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院);Department of Computer Science, City University of Hong Kong(香港城市大学计算机科学系);School of Electronic Information and Communications, Huazhong University of Science and Technology(华中科技大学电子信息与通信学院)
CSS: Overcoming Pose and Scene Challenges in Crowd-Sourced 3D Gaussian Splatting
Beijing University of Posts and Telecommunications(北京邮电大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);China Unicom Smart City Research Institute(中国联通智慧城市研究院)
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting
The Chinese University of Hong Kong(香港中文大学);Stanford University(斯坦福大学);Snap Inc.(Snap公司);University of California Los Angeles(加利福尼亚大学洛杉矶分校);ByteDance(字节跳动)
SurgicalGS: Dynamic 3D Gaussian Splatting for Accurate Robotic-Assisted Surgical Scene Reconstruction
The Hamlyn Centre for Robotic Surgery, Imperial College London(伦敦帝国理工学院哈姆林 robotic外科中心);Hawkes Institute, University College London(伦敦大学学院霍克斯研究所);University of Liverpool(利物浦大学)
Holistic Large-Scale Scene Reconstruction via Mixed Gaussian Splatting
School of Computer Science, Wuhan University(武汉大学计算机学院);School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院);School of Electronic Information, Wuhan University(武汉大学电子信息学院);State Key Lab. of LIESMARS, Wuhan University(武汉大学LIESMARS国家重点实验室);Institute for Math & AI, Wuhan University(武汉大学数学与人工智能研究院)
SceneSplat++: A Large Dataset and Comprehensive Benchmark for Language Gaussian Splatting
Nanjing University of Aeronautics and Astronautics(南京航空航天大学);ETH Zürich(苏黎世联邦理工学院);University of Amsterdam(阿姆斯特丹大学);Johns Hopkins University(约翰·霍普金斯大学);University of Pisa(比萨大学);University of Trento(特伦托大学)
Horizon-GS: Unified 3D Gaussian Splatting for Large-Scale Aerial-to-Ground Scenes
University of Science and Technology of China(中国科学技术大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);The Chinese University of Hong Kong(香港中文大学);Brown University(布朗大学);The University of Hong Kong(香港大学)
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstruction
School of Computing and Data Science, The University of Hong Kong(计算与数据科学学院,香港大学);Futurewei Technologies Inc(未来科技公司);School of Computer and Information Sciences, The University of Newcastle(计算机与信息科学学院,新castle大学)
Seeing Through Reflections: Advancing 3D Scene Reconstruction in Mirror-Containing Environments with Gaussian Splatting
School of Automation and Intelligent Sening, Shanghai Jiao Tong University(自动化与智能传感学院,上海交通大学);Ningbo Artificial Intelligence Institute, Shanghai Jiao Tong University(宁波人工智能研究所,上海交通大学)