Stable-Hair: Real-World Hair Transfer via Diffusion Model
Shanghai Jiao Tong University(上海交通大学);Tiamat AI;Ocean University of China(中国海洋大学);National University of Singapore(新加坡国立大学);Peking University(北京大学);Shenyang Institute of Automation Chinese Academy of Sciences(中国科学院沈阳自动化研究所)
Current hair transfer methods struggle to handle diverse and intricate hairstyles, limiting their applicability in real-world scenarios. In this paper, we propose a novel diffusion-based hair transfer framework, named \textit{Stable-Hair}, which robustly transfers a wide range of real-world hairstyles to user-provided faces for virtual hair try-on. To achieve this goal, our Stable-Hair framework is designed as a two-stage pipeline. In the first stage, we train a Bald Converter alongside stable diffusion to remove hair from the user-provided face images, resulting in bald images. In the second stage, we specifically designed a Hair Extractor and a Latent IdentityNet to transfer the target hairstyle with highly detailed and high-fidelity to the bald image. The Hair Extractor is trained to encode reference images with the desired hairstyles, while the Latent IdentityNet ensures consistency in identity and background. To minimize color deviations between source images and transfer results, we introduce a novel Latent ControlNet architecture, which functions as both the Bald Converter and Latent IdentityNet. After training on our curated triplet dataset, our method accurately transfers highly detailed and high-fidelity hairstyles to the source images. Extensive experiments demonstrate that our approach achieves state-of-the-art performance compared to existing hair transfer methods. Project page: \textcolor{red}{\url{https://xiaojiu-z.github.io/Stable-Hair.github.io/}}
Stable-Hair v2: Real-World Hair Transfer via Multiple-View Diffusion Model
Institute of Information Science, Beijing Jiaotong University(北京交通大学信息科学学院);School of Computer Science, Ocean University of China(中国海洋大学计算机学院);Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学计算机科学与工程系);Artificial Intelligence department, Tiamat AI(Tiamat AI人工智能部门);Department of Information Engineering and Computer Science (DISI), University of Trento(特伦托大学信息工程与计算机科学系)