ExpressEdit: 在Photoshop中使用扩散模型快速编辑风格化面部表情
ExpressEdit: Fast Editing of Stylized Facial Expressions with Diffusion Models in Photoshop
AI总结:
ExpressEdit通过开放源代码的Photoshop插件,实现快速且无伪影的风格化面部表情编辑,结合Liquify等原生功能,提升编辑效率与艺术创作灵活性。
摘要:
角色面部表情是视觉叙事的关键组成部分。尽管当前AI图像编辑模型在帮助艺术家进行风格化表情编辑方面具有潜力,但这些模型会引入全局噪声和像素漂移,阻碍其在专业图像编辑软件和工作流中的整合。为弥合这一差距,我们引入ExpressEdit,一个完全开源的Photoshop插件,无 proprietary 图像编辑模型的常见伪影,并与Liquify等原生Photoshop操作协同工作。ExpressEdit在单个消费级GPU上可无缝编辑表情,仅需3秒,显著快于流行专有模型。此外,为支持根据不同叙事需求生成多样化表情,我们编纂了一个包含135个表情标签的综合性表情数据库,附有示例故事和图像,用于检索增强生成。我们开源代码和数据集以促进未来研究和艺术探索。
英文摘要:
Facial expressions of characters are a vital component of visual storytelling. While current AI image editing models hold promise for assisting artists in the task of stylized expression editing, these models introduce global noise and pixel drift into the edited image, preventing the integration of these models into professional image editing software and workflows. To bridge this gap, we introduce ExpressEdit, a fully open-source Photoshop plugin that is free from common artifacts of proprietary image editing models and robustly synergizes with native Photoshop operations such as Liquify. ExpressEdit seamlessly edits an expression within 3 seconds on a single consumer-grade GPU, significantly faster than popular proprietary models. Moreover, to support the generation of diverse expressions according to different narrative needs, we compile a comprehensive expression database of 135 expression tags enriched with example stories and images designed for retrieval-augmented generation. We open source the code and dataset to facilitate future research and artistic exploration.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。