We introduce GaussianCut, a new method for interactive multiview segmentation of scenes represented as 3D Gaussians. Our approach allows for selecting the objects to be segmented by interacting with a single view. It accepts intuitive user input, such as point clicks, coarse scribbles, or text. Using 3D Gaussian Splatting (3DGS) as the underlying scene representation simplifies the extraction of objects of interest which are considered to be a subset of the scene's Gaussians. Our key idea is to represent the scene as a graph and use the graph-cut algorithm to minimize an energy function to effectively partition the Gaussians into foreground and background. To achieve this, we construct a graph based on scene Gaussians and devise a segmentation-aligned energy function on the graph to combine user inputs with scene properties. To obtain an initial coarse segmentation, we leverage 2D image/video segmentation models and further refine these coarse estimates using our graph construction. Our empirical evaluations show the adaptability of GaussianCut across a diverse set of scenes. GaussianCut achieves competitive performance with state-of-the-art approaches for 3D segmentation without requiring any additional segmentation-aware training.
Seg-Wild: Interactive Segmentation based on 3D Gaussian Splatting for Unconstrained Image Collections
College of Computer Science and Engineering, Shandong University of Science and Technology(山东科技大学计算机科学与工程学院);State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(北京航空航天大学虚拟现实技术与系统国家重点实验室)
提出基于3D Gaussian Splatting的交互式分割方法Seg-Wild,通过多维特征嵌入和Spiky 3D Gaussian Cutter处理无约束图像中的瞬态遮挡,实现更优的野外场景分割与重建质量。
RefGlass-GS: A UAV-Enabled Fusion Framework for Photorealistic, Semantic and Interactive Digitization of Reflective Glass Facades via Gaussian Splatting
Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology(香港科技大学土木与环境工程系);Department of Civil and Environmental Engineering, University of Maryland(马里兰大学土木与环境工程系);Department of the Built Environment, National University of Singapore(新加坡国立大学环境与建筑系);Department of Architecture and Civil Engineering, City University of Hong Kong(香港城市大学建筑与土木工程系)
InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Prior
MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(信息产业部模式分析与机器智能重点实验室,计算机科学与技术学院,南京航空航天大学);The Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(教育部高维信息智能感知与系统重点实验室,计算机科学与工程学院,南京理工大学)
3DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting
D Optical Metrology unit, Fondazione Bruno Kessler(3D光学测绘单元,布鲁诺·凯斯勒基金会);Department of Information Engineering and Computer Science, University of Trento(信息工程与计算机科学系,特伦托大学)
DAV-GSWT: Diffusion-Active-View Sampling for Data-Efficient Gaussian Splatting Wang Tiles
University of Macau(澳门大学);Juntendo University(立命馆大学);Tongji University(同济大学);Renmin University of China(中国人民大学);University of Chinese Academy of Sciences(中国科学院大学);Zhejiang University(浙江大学);University of Liverpool(利物浦大学)
Triangle Splatting+: Differentiable Rendering with Opaque Triangles
University of Liège(利根大学);Simon Fraser University(西蒙弗雷泽大学);University of Maryland(马里兰大学);University of British Columbia(不列颠哥伦比亚大学);University of Toronto(多伦多大学);Adobe Research(Adobe研究)
Hybrid Foveated Path Tracing with Peripheral Gaussians for Immersive Anatomy
Technical University of Munich (TUM), Germany(慕尼黑技术大学);TUM University Hospital, Orthopedics and Sports Orthopedics(TUM大学医院,骨科和运动骨科);Human-Centered Computing and Extended Reality Lab (HEX)(以人为本计算与扩展现实实验室);Munich Institute of Robotics and Machine Intelligence (MIRMI)(慕尼黑机器人与机器智能研究所)
Multi-Layer Gaussian Splatting for Immersive Anatomy Visualization
Technical University of Munich(慕尼黑技术大学);Clinic for Orthopedics and Sports Orthopedics(骨科与运动骨科诊所);TUM University Hospital(慕尼黑技术大学医院);Siemens Healthineers AG(西门子医疗影像有限公司)