ScalingGaussian: Enhancing 3D Content Creation with Generative Gaussian Splatting
School of Information Science and Engineering, East China University of Science and Technology(华东理工大学信息科学与工程学院);University of Washington(华盛顿大学);University of Copenhagen(哥本哈根大学);Tsinghua University(清华大学);FancyTech(范希科技(FancyTech))
Shen Chen, Jiale Zhou, Zhongyu Jiang, Tianfang Zhang, Zongkai Wu, Jenq-Neng Hwang, Lei Li
The creation of high-quality 3D assets is paramount for applications in digital heritage preservation, entertainment, and robotics. Traditionally, this process necessitates skilled professionals and specialized software for the modeling, texturing, and rendering of 3D objects. However, the rising demand for 3D assets in gaming and virtual reality (VR) has led to the creation of accessible image-to-3D technologies, allowing non-professionals to produce 3D content and decreasing dependence on expert input. Existing methods for 3D content generation struggle to simultaneously achieve detailed textures and strong geometric consistency. We introduce a novel 3D content creation framework, ScalingGaussian, which combines 3D and 2D diffusion models to achieve detailed textures and geometric consistency in generated 3D assets. Initially, a 3D diffusion model generates point clouds, which are then densified through a process of selecting local regions, introducing Gaussian noise, followed by using local density-weighted selection. To refine the 3D gaussians, we utilize a 2D diffusion model with Score Distillation Sampling (SDS) loss, guiding the 3D Gaussians to clone and split. Finally, the 3D Gaussians are converted into meshes, and the surface textures are optimized using Mean Square Error(MSE) and Gradient Profile Prior(GPP) losses. Our method addresses the common issue of sparse point clouds in 3D diffusion, resulting in improved geometric structure and detailed textures. Experiments on image-to-3D tasks demonstrate that our approach efficiently generates high-quality 3D assets.
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
GaussianFlow: Splatting Gaussian Dynamics for 4D Content Creation
University of Southern California(南加州大学);Google(谷歌);Pennsylvania State University(宾夕法尼亚州立大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所)
Neural Surface Priors for Editable Gaussian Splatting
IDEAS NCBR;Adam Mickiewicz University(亚当·密茨凯维奇大学);Wrocław University of Science and Technology(弗罗茨瓦夫理工大学);Jagiellonian University(雅盖隆大学);Tooploox;New Jersey Institute of Technology(新泽西理工学院)
Stereo-GS: Multi-View Stereo Vision Model for Generalizable 3D Gaussian Splatting Reconstruction
Department of Computer Science, Hong Kong Baptist University(香港 Baptist 大学计算机科学系);NVIDIA AI Technology Center, NVIDIA(NVIDIA 人工智能技术中心);School of Control Science and Engineering, Shandong University(控制科学与工程学院,山东大学)
Synthetic Dataset Generation for Autonomous Mobile Robots Using 3D Gaussian Splatting for Vision Training
Robotics Section in the Department of Mechanical Engineering(机械工程系机器人部分);Software Engineering and Technology in the Department of Mathematics and Computer Science(数学与计算机科学系软件工程与技术)
3DSceneEditor: Controllable 3D Scene Editing with Gaussian Splatting
D Optical Metrology unit, Fondazione Bruno Kessler(3D光学测绘单元,布鲁诺·凯斯勒基金会);Department of Information Engineering and Computer Science, University of Trento(信息工程与计算机科学系,特伦托大学)
DReSG: Diffusion Residuals for Stylized Gaussian Splatting
School of Software Engineering, East China Normal University(华东师范大学软件工程学院);School of Computer Science and Technology, East China Normal University(华东师范大学计算机科学与技术学院)
SEGA: Drivable 3D Gaussian Head Avatar from a Single Image
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);ByteDance(字节跳动);Pengcheng Lab(鹏城实验室);Department of Automation, Tsinghua University(清华大学自动化系)
Intellectual Property Protection for 3D Gaussian Splatting Assets: A Survey
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);The University of Melbourne(墨尔本大学);Mohamed bin Zayed University of Artificial Intelligence(莫莫迪·本·扎耶德人工智能大学)
TexGaussian: Generating High-quality PBR Material via Octree-based 3D Gaussian Splatting
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Baidu VIS(百度VIS);Institute of Medical Technology, Peking University(北京大学医学技术研究所)
Robust and High-Fidelity 3D Gaussian Splatting: Fusing Pose Priors and Geometry Constraints for Texture-Deficient Outdoor Scenes
School of Mechatronical Engineering, Beijing Institute of Technology(机械电子工程学院,北京理工大学);Beiing National Research Center for Information Science and Technology(北京国家信息科学与技术研究中心);Qiyuan Lab(启元实验室);Peking University(北京大学)
AdLift: Lifting Adversarial Perturbations to Safeguard 3D Gaussian Splatting Assets Against Instruction-Driven Editing
Sydney AI Centre, The University of Sydney(悉尼人工智能中心,悉尼大学);University of Technology Sydney(技术大学悉尼);University of Melbourne(墨尔本大学);Hong Kong Baptist University(香港 Baptist 大学);Mohamed bin Zayed University of Artificial Intelligence(Mohamed bin Zayed 人工智能大学)
SketchFaceGS: Real-Time Sketch-Driven Face Editing and Generation with Gaussian Splatting
Shandong Technology and Business University(山东科技与商务大学);Nanchang Hangkong University(南昌航空大学);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of New South Wales(新南威尔士大学)
GaussianPainter: Painting Point Cloud into 3D Gaussians with Normal Guidance
Beihang University(北京航空航天大学);The Chinese University of Hong Kong(香港中文大学);Chinese Academy of Sciences(中国科学院);Centre for Perceptual and Interactive Intelligence(感知与交互智能研究中心)
Proc-GS: Procedural Building Generation for City Assembly with 3D Gaussians
The Chinese University of Hong Kong(香港中文大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Brown University(布朗大学);Cornell University(康奈尔大学);The University of Hong Kong(香港大学)