arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.08030cs.CVcs.AI
收藏

重新思考文本到图像生成模型时代的艺术版权侵权问题

Rethinking Artistic Copyright Infringements in the Era of Text-to-Image Generative Models

University of Maryland(马里兰大学);George Washington University(乔治华盛顿大学)

Mazda Moayeri, Samyadeep Basu, Sriram Balasubramanian, Priyatham Kattakinda, Atoosa Chengini, Robert Brauneis, Soheil Feizi

AI总结:

该研究将艺术版权侵权问题重构为图像集合分类问题,推出含可解释TagMatch方法的ArtSavant工具,经大规模实证发现仅20%多产艺术家风格存在被主流文生图模型简单提示复制的风险。

摘要:

近期的文本到图像生成模型(如Stable Diffusion)极其擅长模仿和生成受版权保护的内容,这引发了艺术家们的担忧:他们的独特风格可能会被不当复制。理解生成模型如何复制“艺术风格”比复制单张图像更为复杂,因为风格由一组在一系列作品中频繁共同出现的元素(或称标志性特征)构成,而其中每件单独的作品可能存在显著差异。在本文中,我们首先将“艺术版权侵权”问题重新表述为针对图像集合的分类问题,而非探究单张图像之间的相似性。随后我们推出ArtSavant,这是一款实用(即高效且易于理解)的工具,可实现两大功能:(i)通过与从WikiArt整理的、包含372位艺术家作品的参考数据集进行对比,确定某位艺术家的独特风格;(ii)识别所识别出的风格是否会在生成图像中再次出现。我们采用两种互补方法对图像集合进行艺术风格分类,其中包括TagMatch——这是一种全新的、本身具备可解释性与可归因性的方法,因此更适合非技术相关利益方(艺术家、律师、法官等)广泛使用。借助ArtSavant,我们开展了一项大规模实证研究,针对3款主流文本到图像生成模型中艺术风格复制的普遍程度提供了量化洞察。具体而言,在一个包含多产艺术家(其中不乏众多知名艺术家)的数据集里,仅有20%的艺术家的风格存在通过简单提示词被当前主流文本到图像生成模型复制的风险。

英文摘要:

Recent text-to-image generative models such as Stable Diffusion are extremely adept at mimicking and generating copyrighted content, raising concerns amongst artists that their unique styles may be improperly copied. Understanding how generative models copy "artistic style" is more complex than duplicating a single image, as style is comprised by a set of elements (or signature) that frequently co-occurs across a body of work, where each individual work may vary significantly. In our paper, we first reformulate the problem of "artistic copyright infringement" to a classification problem over image sets, instead of probing image-wise similarities. We then introduce ArtSavant, a practical (i.e., efficient and easy to understand) tool to (i) determine the unique style of an artist by comparing it to a reference dataset of works from 372 artists curated from WikiArt, and (ii) recognize if the identified style reappears in generated images. We leverage two complementary methods to perform artistic style classification over image sets, includingTagMatch, which is a novel inherently interpretable and attributable method, making it more suitable for broader use by non-technical stake holders (artists, lawyers, judges, etc). Leveraging ArtSavant, we then perform a large-scale empirical study to provide quantitative insight on the prevalence of artistic style copying across 3 popular text-to-image generative models. Namely, amongst a dataset of prolific artists (including many famous ones), only 20% of them appear to have their styles be at a risk of copying via simple prompting of today's popular text-to-image generative models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑