探索 Civitai 上滥用生成式 AI 模型的情况
Exploring the Use of Abusive Generative AI Models on Civitai
AI总结：
本研究首次对 AIGC 社交平台 Civitai 进行实证分析，基于 87K 模型和 2M 图像的数据集，探讨滥用内容特征并提出审核策略以改善平台治理。
摘要：
生成式 AI 的兴起正在改变数字图像的格局，并对在线创意社区产生重大影响。这导致了 AI 生成内容（AIGC）社交平台的出现，例如 Civitai。这些独特的社交平台允许用户构建和分享自己的生成式 AI 模型，从而增强更多样化艺术表达的潜力。按照社交网络的设计风格，它们也为艺术家提供了展示其创作（由模型生成）、参与讨论和获取反馈的途径，从而培养社区意识。然而，这种开放性也引发了对这类平台滥用的担忧，例如利用模型传播欺骗性的深度伪造或侵犯版权。为了探索这一点，我们首次对 AIGC 社交平台进行了全面的实证研究，重点关注其用于生成滥用内容的情况。作为范例，我们构建了一个涵盖 Civitai（最大的可用 AIGC 社交平台）的综合数据集。基于这个包含 87K 个模型和 2M 张图像的数据集，我们探讨了内容的特征，并讨论了更好的治理这些平台的审核策略。
英文摘要：
The rise of generative AI is transforming the landscape of digital imagery, and exerting a significant influence on online creative communities. This has led to the emergence of AI-Generated Content (AIGC) social platforms, such as Civitai. These distinctive social platforms allow users to build and share their own generative AI models, thereby enhancing the potential for more diverse artistic expression. Designed in the vein of social networks, they also provide artists with the means to showcase their creations (generated from the models), engage in discussions, and obtain feedback, thus nurturing a sense of community. Yet, this openness also raises concerns about the abuse of such platforms, e.g., using models to disseminate deceptive deepfakes or infringe upon copyrights. To explore this, we conduct the first comprehensive empirical study of an AIGC social platform, focusing on its use for generating abusive content. As an exemplar, we construct a comprehensive dataset covering Civitai, the largest available AIGC social platform. Based on this dataset of 87K models and 2M images, we explore the characteristics of content and discuss strategies for moderation to better govern these platforms.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
