arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.09337cs.HCcs.AIcs.MM
收藏

Promptify:通过与大型语言模型进行交互式提示词探索实现文本到图像生成

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models

University of Toronto(多伦多大学);Dalhousie University(达尔豪斯大学)

Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, Tovi Grossman

AI总结:

本文提出交互式系统 Promptify,利用大型语言模型建议并迭代细化图像生成提示词,用户研究表明其可优化创作工作流并优于现有基线工具。

摘要:

文本到图像生成模型已经展现出根据文本提示词生成高质量图像的卓越能力。然而,编写能够准确捕捉用户创作意图的提示词仍然具有挑战性。为确保模型按照用户意图理解提示词,通常需要繁琐的试错过程。为应对这些挑战,我们提出 Promptify,这是一个支持文本到图像生成模型提示词探索与细化的交互式系统。Promptify 利用由大型语言模型驱动的建议引擎,帮助用户快速探索并构建多样化提示词。我们的界面允许用户灵活组织生成的图像,并根据其偏好,由 Promptify 建议对原始提示词进行潜在修改。这一反馈循环使用户能够迭代细化提示词,增强所需特征,同时避免不需要的特征。我们的用户研究表明,Promptify 有效促进了文本到图像工作流,并且优于一种广泛用于文本到图像生成的现有基线工具。

英文摘要:

Text-to-image generative models have demonstrated remarkable capabilities in generating high-quality images based on textual prompts. However, crafting prompts that accurately capture the user's creative intent remains challenging. It often involves laborious trial-and-error procedures to ensure that the model interprets the prompts in alignment with the user's intention. To address the challenges, we present Promptify, an interactive system that supports prompt exploration and refinement for text-to-image generative models. Promptify utilizes a suggestion engine powered by large language models to help users quickly explore and craft diverse prompts. Our interface allows users to organize the generated images flexibly, and based on their preferences, Promptify suggests potential changes to the original prompt. This feedback loop enables users to iteratively refine their prompts and enhance desired features while avoiding unwanted ones. Our user study shows that Promptify effectively facilitates the text-to-image workflow and outperforms an existing baseline tool widely used for text-to-image generation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑