arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.02599cs.CV
收藏

PEO:基于提示嵌入优化的预训练文本到图像扩散模型免训练美学质量增强

PEO: Training-Free Aesthetic Quality Enhancement in Pre-Trained Text-to-Image Diffusion Models with Prompt Embedding Optimization

KU Leuven(鲁文大学);Université Paris-Saclay(巴黎-萨克雷大学);Meta

Hovhannes Margaryan, Bo Wan, Tinne Tuytelaars

AI总结:

本研究提出免训练的PEO方法,通过三重目标函数优化文本嵌入,在不依赖特定主干、无需训练的前提下提升预训练文本到图像扩散模型的生成美学质量,性能达当前最优水平。

摘要:

本文提出了一种在给定简单提示时提升预训练文本到图像扩散模型生成图像美学质量的新方法。我们的方法名为Prompt Embedding Optimization(提示嵌入优化,简称PEO),以预训练文本到图像扩散模型为主干,通过优化给定的简单未筛选提示的文本嵌入,提升生成图像的视觉质量。我们通过三重目标函数实现这一目标:提升生成图像的美学保真度、确保生成结果与优化后的文本嵌入一致、最小化与初始提示的差异,其中最后一点通过提示保留项实现。此外,PEO无需训练且不依赖特定主干模型。定量与定性评估证实了该方法的有效性,其性能超过或持平于当前最优的文本到图像及提示适配方法。

英文摘要:

This paper introduces a novel approach to aesthetic quality improvement in pre-trained text-to-image diffusion models when given a simple prompt. Our method, dubbed Prompt Embedding Optimization (PEO), leverages a pre-trained text-to-image diffusion model as a backbone and optimizes the text embedding of a given simple and uncurated prompt to enhance the visual quality of the generated image. We achieve this by a tripartite objective function that improves the aesthetic fidelity of the generated image, ensures adherence to the optimized text embedding, and minimal divergence from the initial prompt. The latter is accomplished through a prompt preservation term. Additionally, PEO is training-free and backbone-independent. Quantitative and qualitative evaluations confirm the effectiveness of the proposed method, exceeding or equating the performance of state-of-the-art text-to-image and prompt adaptation methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑