arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.08477cs.HC
收藏

视觉艺术家创作作品的大规模文本图像生成模型

Large-scale Text-to-Image Generation Models for Visual Artists' Creative Works

Hyung-Kwon Ko, Gwanmo Park, Hyeon Jeon, Jaemin Jo, Juho Kim, Jinwook Seo

摘要:

大规模文本到图像生成模型(LTGM)(例如,DALL-E),在巨大数据集上训练的自监督深度学习模型,已经证明了从多模态输入生成高质量开放域图像的能力。尽管它们甚至可以产生物体和动物的拟人化版本,以合理的方式组合不相关的概念,并为任何用户提供的图像提供变化,但我们目睹了如此快速的技术进步,使许多视觉艺术家在他们的创作作品中更积极地利用LTGM。我们在这项工作中的目标是了解视觉艺术家将如何采用LTGM来支持他们的创意作品。为此,我们进行了访谈研究,以及系统的文献回顾72系统/应用论文进行彻底的检查。共有28位视觉艺术家,涵盖35个不同的视觉艺术领域,承认LTGM的多功能作用,具有高可用性,以支持创作过程自动化的创意作品(即,自动化),扩展他们的想法(即,勘探),以及促进或仲裁通信(即,调解)。最后,我们提供了四个设计准则,未来的研究人员可以参考使用LTGM智能用户界面。

英文摘要:

Large-scale Text-to-image Generation Models (LTGMs) (e.g., DALL-E), self-supervised deep learning models trained on a huge dataset, have demonstrated the capacity for generating high-quality open-domain images from multi-modal input. Although they can even produce anthropomorphized versions of objects and animals, combine irrelevant concepts in reasonable ways, and give variation to any user-provided images, we witnessed such rapid technological advancement left many visual artists disoriented in leveraging LTGMs more actively in their creative works. Our goal in this work is to understand how visual artists would adopt LTGMs to support their creative works. To this end, we conducted an interview study as well as a systematic literature review of 72 system/application papers for a thorough examination. A total of 28 visual artists covering 35 distinct visual art domains acknowledged LTGMs' versatile roles with high usability to support creative works in automating the creation process (i.e., automation), expanding their ideas (i.e., exploration), and facilitating or arbitrating in communication (i.e., mediation). We conclude by providing four design guidelines that future researchers can refer to in making intelligent user interfaces using LTGMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑