AI生成图像中的视觉真实性:计算指标与以人为中心的分析
Visual Verity in AI-Generated Imagery: Computational Metrics and Human-Centric Analysis
AI总结:
本文通过三项研究提出并验证Visual Verity问卷,比较AI生成图像与相机图像的质量差异,并提出NFSS指标,以改进AI生成内容的评估方法。
摘要:
人工智能技术的快速发展已经彻底改变了娱乐、广告和电子商务等多个领域中图形内容的生产方式。这些发展催生了对稳健评估方法的需求,以评估AI生成图像的质量和真实感。为了解决这一问题,我们进行了三项研究。首先,我们引入并验证了一份名为Visual Verity的问卷,该问卷用于测量照片真实感、图像质量和文本-图像对齐程度。其次,我们应用该问卷评估来自AI模型(DALL-E2、DALL-E3、GLIDE、Stable Diffusion)的图像和相机生成图像,结果表明相机生成图像在照片真实感和文本-图像对齐方面表现更优,而AI模型在图像质量方面领先。我们还分析了统计特性,发现相机生成图像在色相、饱和度和亮度方面得分较低。第三,我们评估了计算指标与人类判断的一致性,确定MS-SSIM和CLIP与人类评估最为一致。此外,我们提出了用于评估图像质量的神经特征相似度评分(NFSS)。我们的研究结果强调需要改进计算指标以更好地捕捉人类视觉感知,从而增强AI生成内容的评估。
英文摘要:
The rapid advancements in AI technologies have revolutionized the production of graphical content across various sectors, including entertainment, advertising, and e-commerce. These developments have spurred the need for robust evaluation methods to assess the quality and realism of AI-generated images. To address this, we conducted three studies. First, we introduced and validated a questionnaire called Visual Verity, which measures photorealism, image quality, and text-image alignment. Second, we applied this questionnaire to assess images from AI models (DALL-E2, DALL-E3, GLIDE, Stable Diffusion) and camera-generated images, revealing that camera-generated images excelled in photorealism and text-image alignment, while AI models led in image quality. We also analyzed statistical properties, finding that camera-generated images scored lower in hue, saturation, and brightness. Third, we evaluated computational metrics' alignment with human judgments, identifying MS-SSIM and CLIP as the most consistent with human assessments. Additionally, we proposed the Neural Feature Similarity Score (NFSS) for assessing image quality. Our findings highlight the need for refining computational metrics to better capture human visual perception, thereby enhancing AI-generated content evaluation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。