3D content creation from a single image is a long-standing yet highly desirable task. Recent advances introduce 2D diffusion priors, yielding reasonable results. However, existing methods are not hyper-realistic enough for post-generation usage, as users cannot view, render and edit the resulting 3D content from a full range. To address these challenges, we introduce HyperDreamer with several key designs and appealing properties: 1) Viewable: 360 degree mesh modeling with high-resolution textures enables the creation of visually compelling 3D models from a full range of observation points. 2) Renderable: Fine-grained semantic segmentation and data-driven priors are incorporated as guidance to learn reasonable albedo, roughness, and specular properties of the materials, enabling semantic-aware arbitrary material estimation. 3) Editable: For a generated model or their own data, users can interactively select any region via a few clicks and efficiently edit the texture with text-based guidance. Extensive experiments demonstrate the effectiveness of HyperDreamer in modeling region-aware materials with high-resolution textures and enabling user-friendly editing. We believe that HyperDreamer holds promise for advancing 3D content creation and finding applications in various domains.
Prompt-to-Prompt: Text-Based Image Editing Via Cross-Attention Mechanisms -- The Research of Hyperparameters and Novel Mechanisms to Enhance Existing Frameworks
Guide-and-Rescale: Self-Guidance Mechanism for Effective Tuning-Free Real Image Editing
HSE University(高等经济大学);AIRI(人工智能研究中心);Constructor University(康斯特大学);Skolkovo Institute of Science and Technology(斯科尔科沃科学技术研究所);UNSW Sydney(新南威尔士大学悉尼分校)
AttriHuman-3D: Editable 3D Human Avatar Generation with Attribute Decomposition and Indexing
S-Lab, Nanyang Technological University(新加坡南洋理工大学S-Lab);School of Computer Science and Engineering, South China University of Technology(华南理工大学计算机科学与工程学院);SenseTime Research(商汤科技研究院)