GS-PT: Exploiting 3D Gaussian Splatting for Comprehensive Point Cloud Understanding via Self-supervised Learning
School of Computer Science, Fudan University（复旦大学计算机科学学院）；School of Mechanical Engineering, Tongji University（同济大学机械工程学院）；Academy for Engineering and Technology, Fudan University（复旦大学工程技术研究院）
Self-supervised learning of point cloud aims to leverage unlabeled 3D data to learn meaningful representations without reliance on manual annotations. However, current approaches face challenges such as limited data diversity and inadequate augmentation for effective feature learning. To address these challenges, we propose GS-PT, which integrates 3D Gaussian Splatting (3DGS) into point cloud self-supervised learning for the first time. Our pipeline utilizes transformers as the backbone for self-supervised pre-training and introduces novel contrastive learning tasks through 3DGS. Specifically, the transformers aim to reconstruct the masked point cloud. 3DGS utilizes multi-view rendered images as input to generate enhanced point cloud distributions and novel view images, facilitating data augmentation and cross-modal contrastive learning. Additionally, we incorporate features from depth maps. By optimizing these tasks collectively, our method enriches the tri-modal self-supervised learning process, enabling the model to leverage the correlation across 3D point clouds and 2D images from various modalities. We freeze the encoder after pre-training and test the model's performance on multiple downstream tasks. Experimental results indicate that GS-PT outperforms the off-the-shelf self-supervised learning methods on various downstream tasks including 3D object classification, real-world classifications, and few-shot learning and segmentation.
School of Computer Science and Technology, Huazhong University of Science and Technology（华中科技大学计算机科学与技术学院）；School of Software Technology, Zhejiang University（浙江大学软件学院）
EMD: Explicit Motion Modeling for High-Quality Street Gaussian Splatting
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University（信息处理国家重点实验室，计算机学院，北京大学）；Autonomous Driving Development, NIO（自动驾驶研发，蔚来）；Institute of Software, Chinese Academy of Sciences（软件研究所，中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Intel Labs China（英特尔中国实验室）
GSRender: Deduplicated Occupancy Prediction via Weakly Supervised 3D Gaussian Splatting
Tsinghua Shenzhen International Graduate School, Tsinghua University（清华大学深圳国际研究生院）；Houmo AI；Dalian University of Technology（大连理工大学）；The Hong Kong University of Science and Technology（香港科学与技术大学）
Reprojection-Guided 3D Gaussian Splatting Diffusion for Weakly Supervised Single-Image Normal Estimation
School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, China（江南大学人工智能与计算机科学学院，中国无锡）；School of Data Science, Lingnan University, Hong Kong, China（岭南大学数据科学学院，中国香港）
FreGS: 3D Gaussian Splatting with Progressive Frequency Regularization
Nanyang Technological University（南洋理工大学）；Max Planck Institute for Informatics（马克斯·普朗克信息学研究所）；Carnegie Mellon University（卡内基梅隆大学）；MBZUAI（穆罕默德·本·扎耶德人工智能大学）
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China（脑启发式智能感知与认知联合实验室，中国科学技术大学）；University of Missouri, Kansas City（密苏里大学，堪萨斯城）
GALA: Guided Attention with Language Alignment for Open Vocabulary Gaussian Splatting
Technical University of Munich（慕尼黑技术大学）；Universitat Politècnica de Catalunya（巴塞罗那技术大学）；Google（谷歌）；Munich Center for Machine Learning（慕尼黑机器学习中心）；University of Tubingen（图宾根大学）；ETH Zurich（苏黎世联邦理工学院）；Visualais
SGD: Street View Synthesis with Gaussian Splatting and Diffusion Prior
ETH Zürich（苏黎世联邦理工学院）；Baidu Research（百度研究院）；University of Chinese Academy of Sciences（中国科学院大学）；Harbin Institute of Technology（哈尔滨工业大学）；Tianjin University（天津大学）
X$^{2}$-Gaussian: 4D Radiative Gaussian Splatting for Continuous-time Tomographic Reconstruction
The Chinese University of Hong Kong（香港中文大学）；Johns Hopkins University（约翰霍普金斯大学）；The Australian National University（澳大利亚国立大学）；University of Texas at Austin（德克萨斯大学奥斯汀分校）
GaussianCAD: Robust Self-Supervised CAD Reconstruction from Three Orthographic Views Using 3D Gaussian Splatting
State Grid Hubei Electric Power Co., Ltd.（国网湖北省电力有限公司）；School of Intelligent Engineering and Automation, Beijing University of Posts and Telecommunications（北京邮电大学智能工程与自动化学院）
PLANA3R: Zero-shot Metric Planar 3D Reconstruction via Feed-Forward Planar Splatting
The Hong Kong University of Science and Technology（香港科技大学）；Ant Group（蚂蚁集团）；Wuhan University（武汉大学）；Zhejiang University（浙江大学）；The Pennsylvania State University（宾夕法尼亚州立大学）
