ChatFace：通过扩散潜空间操纵实现聊天引导的真实人脸编辑
ChatFace: Chat-Guided Real Face Editing via Diffusion Latent Space Manipulation
AI总结：
本文提出ChatFace，通过对齐扩散模型时间特征与语义条件，在语义潜空间中实现文本引导的零样本真实人脸精确编辑，并结合LLM支持对话式多属性操纵。
摘要：
编辑真实人脸图像是计算机视觉中的一项关键任务，在各类现实应用中具有显著需求。尽管基于GAN的方法在图像操纵方面已展现出潜力，尤其是在与CLIP结合时，但由于GAN反演能力颇具挑战，这些方法在重建真实图像方面存在局限。尽管基于扩散的方法已成功实现图像重建，但在根据文本指令有效操纵细粒度面部属性方面仍存在挑战。为解决这些问题并便于对真实人脸图像进行便捷操纵，我们提出了一种新颖方法，在扩散模型的语义潜空间中执行文本驱动的图像编辑。通过在生成过程中将扩散模型的时间特征与语义条件对齐，我们引入了一种稳定的操纵策略，可有效执行精确的零样本操纵。此外，我们开发了名为ChatFace的交互式系统，该系统结合大型语言模型的零样本推理能力，在扩散语义潜空间中执行高效操纵。该系统使用户能够通过对话执行复杂的多属性操纵，为交互式图像编辑开辟了新的可能性。大量实验证实，我们的方法优于以往方法，并能够精确编辑真实人脸图像，使其成为现实应用中颇具前景的候选方案。项目页面：https://dongxuyue.github.io/chatface/
英文摘要：
Editing real facial images is a crucial task in computer vision with significant demand in various real-world applications. While GAN-based methods have showed potential in manipulating images especially when combined with CLIP, these methods are limited in their ability to reconstruct real images due to challenging GAN inversion capability. Despite the successful image reconstruction achieved by diffusion-based methods, there are still challenges in effectively manipulating fine-gained facial attributes with textual instructions.To address these issues and facilitate convenient manipulation of real facial images, we propose a novel approach that conduct text-driven image editing in the semantic latent space of diffusion model. By aligning the temporal feature of the diffusion model with the semantic condition at generative process, we introduce a stable manipulation strategy, which perform precise zero-shot manipulation effectively. Furthermore, we develop an interactive system named ChatFace, which combines the zero-shot reasoning ability of large language models to perform efficient manipulations in diffusion semantic latent space. This system enables users to perform complex multi-attribute manipulations through dialogue, opening up new possibilities for interactive image editing. Extensive experiments confirmed that our approach outperforms previous methods and enables precise editing of real facial images, making it a promising candidate for real-world applications. Project page: https://dongxuyue.github.io/chatface/
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
