We address the task of generating 3D hair geometry from a single image, which is challenging due to the diversity of hairstyles and the lack of paired image-to-3D hair data. Previous methods are primarily trained on synthetic data and cope with the limited amount of such data by using low-dimensional intermediate representations, such as guide strands and scalp-level embeddings, that require post-processing to decode, upsample, and add realism. These approaches fail to reconstruct detailed hair, struggle with curly hair, or are limited to handling only a few hairstyles. To overcome these limitations, we propose DiffLocks, a novel framework that enables detailed reconstruction of a wide variety of hairstyles directly from a single image. First, we address the lack of 3D hair data by automating the creation of the largest synthetic hair dataset to date, containing 40K hairstyles. Second, we leverage the synthetic hair dataset to learn an image-conditioned diffusion-transfomer model that generates accurate 3D strands from a single frontal image. By using a pretrained image backbone, our method generalizes to in-the-wild images despite being trained only on synthetic data. Our diffusion model predicts a scalp texture map in which any point in the map contains the latent code for an individual hair strand. These codes are directly decoded to 3D strands without post-processing techniques. Representing individual strands, instead of guide strands, enables the transformer to model the detailed spatial structure of complex hairstyles. With this, DiffLocks can recover highly curled hair, like afro hairstyles, from a single image for the first time. Data and code is available at https://radualexandru.github.io/difflocks/
Two-phase Hair Image Synthesis by Self-Enhancing Generative Model
Megvii (Face++) USA(旷视(Face++)美国);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Shenzhen Research Institute of Big Data, CUHK(SZ)(香港中文大学(深圳)深圳大数据研究院)
Describe What to Change: A Text-guided Unsupervised Image-to-Image Translation Approach
University of Trento(特伦托大学);FBK(布鲁诺·凯斯勒基金会);The Chinese University of Hong Kong(香港中文大学);Tencent AI Lab(腾讯人工智能实验室);Inria Grenoble Rhône-Alpes(法国国家信息与自动化研究所格勒诺布尔罗讷-阿尔卑斯中心);Huawei Research(华为研究院)
Local Facial Attribute Transfer through Inpainting
Fraunhofer ITWM(弗劳恩霍夫工业数学研究所);IWR, University of Heidelberg(海德堡大学交互计算与可视化研究所);Fraunhofer Center Machine Learning(弗劳恩霍夫机器学习中心);Institute for Machine Learning and Analytics, Offenburg University(奥芬堡大学机器学习与分析研究所)
ChildDiffusion: Unlocking the Potential of Generative AI and Controllable Augmentations for Child Facial Data using Stable Diffusion and Large Language Models
College of Science and Engineering, University of Galway(高威大学科学与工程学院)