arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.06389cs.AIcs.HCcs.MM
收藏

基于人类审美偏好的大型文本到图像模型个性化:以 Kandinsky 生成为例

Human Aesthetic Preference-Based Large Text-to-Image Model Personalization: Kandinsky Generation as an Example

Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))

Aven-Le Zhou, Yu-Ao Wang, Wei Wu, Kang Zhang

AI总结:

本文提出一种免提示的生成方法,通过语义注入定制艺术家模型,并利用遗传算法结合人类实时反馈,实现基于用户审美偏好的个性化绘画内容生成。

摘要:

随着神经生成能力的进步,艺术社区已积极拥抱生成式人工智能(GenAI)来创作绘画内容。大型文本到图像模型能够快速生成美观的结果。然而,这一过程可能具有非确定性,并且常常涉及繁琐的试错,因为用户在制定有效提示词以实现其期望结果方面存在困难。本文提出了一种免提示的生成方法,使用户能够自动生成融入其审美偏好的个性化绘画内容,并采用定制化的艺术风格。该方法利用“语义注入”来定制特定艺术风格的艺术家模型,并进一步利用遗传算法通过实时迭代的人类反馈优化提示词生成过程。仅依靠用户对艺术家模型生成图像的审美评价和偏好,该方法为用户创建了一个包含其审美偏好和定制化艺术风格的个性化模型。

英文摘要:

With the advancement of neural generative capabilities, the art community has actively embraced GenAI (generative artificial intelligence) for creating painterly content. Large text-to-image models can quickly generate aesthetically pleasing outcomes. However, the process can be non-deterministic and often involves tedious trial-and-error, as users struggle with formulating effective prompts to achieve their desired results. This paper introduces a prompting-free generative approach that empowers users to automatically generate personalized painterly content that incorporates their aesthetic preferences in a customized artistic style. This approach involves utilizing ``semantic injection'' to customize an artist model in a specific artistic style, and further leveraging a genetic algorithm to optimize the prompt generation process through real-time iterative human feedback. By solely relying on the user's aesthetic evaluation and preference for the artist model-generated images, this approach creates the user a personalized model that encompasses their aesthetic preferences and the customized artistic style.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑