Feature Splatting: Language-Driven Physics-Based Scene Synthesis and Editing
University of California San Diego(加利福尼亚大学圣迭戈分校);Massachusetts Institute of Technology(麻省理工学院);Institute for Artificial Intelligence and Fundamental Interactions(人工智能与基本相互作用研究所)
Scene representations using 3D Gaussian primitives have produced excellent results in modeling the appearance of static and dynamic 3D scenes. Many graphics applications, however, demand the ability to manipulate both the appearance and the physical properties of objects. We introduce Feature Splatting, an approach that unifies physics-based dynamic scene synthesis with rich semantics from vision language foundation models that are grounded by natural language. Our first contribution is a way to distill high-quality, object-centric vision-language features into 3D Gaussians, that enables semi-automatic scene decomposition using text queries. Our second contribution is a way to synthesize physics-based dynamics from an otherwise static scene using a particle-based simulator, in which material properties are assigned automatically via text queries. We ablate key techniques used in this pipeline, to illustrate the challenge and opportunities in using feature-carrying 3D Gaussians as a unified format for appearance, geometry, material properties and semantics grounded on natural language. Project website: https://feature-splatting.github.io/
View-Consistent 3D Editing with Gaussian Splatting
Nanyang Technological University(南洋理工大学);Institute for Infocomm Research, A*STAR(新加坡资讯通信研究院(新加坡科技研究局下属));Singapore University of Technology and Design(新加坡科技设计大学);Skywork AI(天工AI);Hong Kong University of Science and Technology(香港科技大学)
3DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting
The Chinese University of Hong Kong(香港中文大学);Stanford University(斯坦福大学);Snap Inc.(Snap公司);University of California Los Angeles(加利福尼亚大学洛杉矶分校);ByteDance(字节跳动)
SVGS: Single-View to 3D Object Editing via Gaussian Splatting
School of Computer Science and Technology, Zhejiang Gongshang University(浙江工商大学计算机科学与技术学院);Zhejiang Key Laboratory of Big Data and Future E-Commerce Technology(浙江省大数据与未来电子商务技术重点实验室);Jianpei Technology Co., Ltd.(建培科技有限公司);School of Artificial Intelligence and Computer Science, Nantong University(南通大学人工智能与计算机科学学院);Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam Bin Abdulaziz University(沙特本·阿卜杜勒阿齐兹王子大学计算机工程与科学学院计算机科学系);Department of Computer Science, Faculty of Computers and Information, Qena University(基纳大学计算机与信息学院计算机科学系);Department of Computing Sciences, Faculty of Information Technology and Communication Sciences, Tampere University(坦佩雷大学信息技术与通信科学学院计算科学系);Division of Oral and Maxillofacial Surgery, Faculty of Dentistry, The University of Hong Kong(香港大学牙医学院口腔颌面外科);Systems Research Institute of the Polish Academy of Sciences(波兰科学院系统研究所);AGH University of Krakow(AGH科技大学);SAN University(SAN大学)
AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editing
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);University of Technology Sydney(技术大学悉尼);University of Melbourne(墨尔本大学);Hong Kong Baptist University(香港 Baptist 大学);Mohamed bin Zayed University of Artificial Intelligence(Mohamed bin Zayed 人工智能大学)
InterGSEdit: Interactive 3D Gaussian Splatting Editing with 3D Geometry-Consistent Attention Prior
MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(信息产业部模式分析与机器智能重点实验室,计算机科学与技术学院,南京航空航天大学);The Key Lab of Intelligent Perception and Systems for High-Dimensional Information of Ministry of Education, School of Computer Science and Engineering, Nanjing University of Science and Technology(教育部高维信息智能感知与系统重点实验室,计算机科学与工程学院,南京理工大学)
TrAME: Trajectory-Anchored Multi-View Editing for Text-Guided 3D Gaussian Splatting Manipulation
School of Information Science and Technology, University of Science and Technology of China(中国科学技术大学信息科学技术学院);Space AI, Li Auto(理想汽车空间人工智能部门);Department of Automation, Tsinghua University(清华大学自动化系)
SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting
Shandong Technology and Business University(山东科技与商务大学);Nanchang Hangkong University(南昌航空大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of New South Wales(新南威尔士大学)
3DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting
D Optical Metrology unit, Fondazione Bruno Kessler(3D光学测绘单元,布鲁诺·凯斯勒基金会);Department of Information Engineering and Computer Science, University of Trento(信息工程与计算机科学系,特伦托大学)
Neural Surface Priors for Editable Gaussian Splatting
IDEAS NCBR;Adam Mickiewicz University(亚当·密茨凯维奇大学);Wrocław University of Science and Technology(弗罗茨瓦夫理工大学);Jagiellonian University(雅盖隆大学);Tooploox;New Jersey Institute of Technology(新泽西理工学院)
CRUISE: Cooperative Reconstruction and Editing in V2X Scenarios using Gaussian Splatting
Institute for AI Industry Research (AIR), Tsinghua University(人工智能产业研究院(AIR),清华大学);Beijing Institute of Technology(北京理工大学);Nanyang Technological University(南洋理工大学);Tsinghua University(清华大学);Renmin University of China(中国人民大学);Beijing University of Technology(北京理工大学);Baidu Inc(百度公司);Peking University(北京大学);Shanghai AI Lab(上海人工智能实验室);Westlake University(西湖大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院)
提出 CRUISE 框架,利用分解式 Gaussian Splatting 重建并编辑 V2X 场景,实现多视角数据增强,提升协同 3D 检测、跟踪及边角案例生成能力。
UltraGS: Real-Time Physically-Decoupled Gaussian Splatting for Ultrasound Novel View Synthesis
2 Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, China;3 School of Medicine, Nankai University, Tianjin, China;4 School of Medicine, Anhui University of Science \& Technology, Huainan, China