In this paper, we address the critical bottleneck in robotics caused by the scarcity of diverse 3D data by presenting a novel two-stage approach for generating high-quality 3D models from a single image. This method is motivated by the need to efficiently expand 3D asset creation, particularly for robotics datasets, where the variety of object types is currently limited compared to general image datasets. Unlike previous methods that primarily rely on general diffusion priors, which often struggle to align with the reference image, our approach leverages subject-specific prior knowledge. By incorporating subject-specific priors in both geometry and texture, we ensure precise alignment between the generated 3D content and the reference object. Specifically, we introduce a shading mode-aware prior into the NeRF optimization process, enhancing the geometry and refining texture in the coarse outputs to achieve superior quality. Extensive experiments demonstrate that our method significantly outperforms prior approaches.
DreamScape: 3D Scene Creation via Gaussian Splatting joint Correlation Modeling
School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
One-shot Implicit Animatable Avatars with Model-based Priors
Zhejiang University(浙江大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Cambridge(剑桥大学);Xiaohongshu Inc.(小红书公司);Fullong Inc.(福龙公司)
SEGA: Drivable 3D Gaussian Head Avatar from a Single Image
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);ByteDance(字节跳动);Pengcheng Lab(鹏城实验室);Department of Automation, Tsinghua University(清华大学自动化系)
Efficient Portrait Matte Creation With Layer Diffusion and Connectivity Priors
School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(华中科技大学人工智能与自动化学院)
Machine learning applied to emerald gemstone grading: framework proposal and creation of a public dataset
Department of Academic Informatics (DAINF), Universidade Tecnológica Federal do Paraná (UTFPR), Pato Branco, State of Parana, Brazil(学术信息系(DAINF),联邦技术大学Parana分校(UTFPR),Pato Branco,巴西巴拉那州)
A Few-Shot Learning Approach for Accelerated MRI via Fusion of Data-Driven and Subject-Driven Priors
Bilkent University(比尔肯特大学);National Magnetic Resonance Research Center (UMRAM)(国家磁共振研究中心(UMRAM));Neuroscience Program, Aysel Sabuncu Brain Research Center, Bilkent University(比尔肯特大学艾塞尔·萨本居脑研究中心神经科学项目)
Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstruction
School of Biomedical Engineering and Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与影像科学学院);Institute of Psychiatry, Psychology and Neuroscience, King’s College London(伦敦国王学院精神病学、心理学与神经科学研究所);King’s College London(伦敦国王学院);Guy’s & St Thomas’ PET Centre(盖伊和圣托马斯PET中心)
WildAvatar: Learning In-the-wild 3D Avatars from the Web
School of AIA, Huazhong University of Science and Technology(华中科技大学AIA学院);S-Lab, Nanyang Technological University(南洋理工大学S-Lab);Great Bay University(大湾区大学);Shanghai AI Laboratory(上海人工智能实验室)
How to Build Digital Humans? From Priors to Photorealistic Avatars
Meta;Technical University of Munich(慕尼黑技术大学);Google(谷歌);Tsinghua University(清华大学);Max Planck Institute for Intelligent Systems(智能系统马克斯·普朗克研究所);NVIDIA;Technical University of Darmstadt(达姆施塔特技术大学);ETH Zurich(苏黎世联邦理工学院)
Noise Consistency Regularization for Improved Subject-Driven Image Synthesis
The Australian National University(澳大利亚国立大学);Rutgers University(罗格斯大学);Data61 CSIRO(澳大利亚联邦科学与工业研究组织 Data61);Mitsubishi Electric Research Laboratories (MERL)(三菱电机研究实验室)
Enhancing and Accelerating Brain MRI through Deep Learning Reconstruction Using Prior Subject-Specific Imaging
Department of Electrical and Software Engineering, University of Calgary(电气与软件工程系,卡尔加里大学);Departments of Radiology and Clinical Neuroscience, University of Calgary(放射学与临床神经科学系,卡尔加里大学);Department of Biomedical Engineering, University of Calgary(生物医学工程系,卡尔加里大学);Department of Radiology, University Hospital Basel(放射学系,巴塞尔大学医院);Department of Neurology, University Hospital Basel(神经病学系,巴塞尔大学医院);Hotchkiss Brain Institute, University of Calgary(霍奇基斯脑研究所,卡尔加里大学)