Hair editing is an interesting and challenging problem in computer vision and graphics. Many existing methods require well-drawn sketches or masks as conditional inputs for editing, however these interactions are neither straightforward nor efficient. In order to free users from the tedious interaction process, this paper proposes a new hair editing interaction mode, which enables manipulating hair attributes individually or jointly based on the texts or reference images provided by users. For this purpose, we encode the image and text conditions in a shared embedding space and propose a unified hair editing framework by leveraging the powerful image text representation capability of the Contrastive Language-Image Pre-Training (CLIP) model. With the carefully designed network structures and loss functions, our framework can perform high-quality hair editing in a disentangled manner. Extensive experiments demonstrate the superiority of our approach in terms of manipulation accuracy, visual realism of editing results, and irrelevant attribute preservation. Project repo is https://github.com/wty-ustc/HairCLIP.
HairCLIPv2: Unifying Hair Editing via Proxy Feature Blending
University of Science and Technology of China(中国科学技术大学);Microsoft Cloud AI(微软云人工智能部门);City University of Hong Kong(香港城市大学);Xi’an Jiaotong University(西安交通大学)
HairDiffusion: Vivid Multi-Colored Hair Editing via Latent Diffusion
School of Computer Science & Software Engineering, Shenzhen University(深圳大学计算机与软件学院);Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳市人工智能与机器人研究院);National Engineering Laboratory for Big Data System Computing Technology, Shenzhen University(深圳大学国家大数据系统计算技术工程实验室);Guangdong Provincial Key Laboratory of Intelligent Information Processing(广东省智能信息处理重点实验室)
Vietnam National University, Ho Chi Minh City, Vietnam(越南国家大学,胡志明市,越南);University of Information Technology, VNU-HCM, Ho Chi Minh City, Vietnam(信息技术大学,VNU-HCM,胡志明市,越南)
Stable-Hair: Real-World Hair Transfer via Diffusion Model
Shanghai Jiao Tong University(上海交通大学);Tiamat AI;Ocean University of China(中国海洋大学);National University of Singapore(新加坡国立大学);Peking University(北京大学);Shenyang Institute of Automation Chinese Academy of Sciences(中国科学院沈阳自动化研究所)
针对真实世界复杂发型迁移难题,本文提出两阶段扩散框架 Stable-Hair,通过 Bald Converter、Hair Extractor、Latent IdentityNet 与 Latent ControlNet 实现高细节、高保真且保持身份背景的虚拟试发。
Pose Guided Human Image Synthesis with Partially Decoupled GAN
Ping An Technology (Shenzhen) Co., Ltd.(平安科技(深圳)有限公司);University of Science and Technology of China(中国科学技术大学);Shanghai International Studies University(上海外国语大学)
SegTalker: Segmentation-based Talking Face Generation with Mask-guided Local Editing
South China University of Technology(华南理工大学);Zhejiang University(浙江大学);Huawei Cloud Computing Technologies Co., Ltd(华为云计算技术有限公司);Peking University(北京大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳))