arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2412.05325cs.CVeess.IV

文本生成图像模型在高级风格迁移应用中的作用:基于DALL-E 3的案例研究

The Role of Text-to-Image Models in Advanced Style Transfer Applications: A Case Study with DALL-E 3

University of Trento(特伦托大学)

Ebubechukwu Ike

AI总结:

本研究将DALL-E 3生成的风格图像与传统神经风格迁移模型结合,经SSIM、PSNR及处理时间评测,证实该方案在提升风格化图像多样性与艺术质量的同时,总处理速度比传统方法快约2.5秒,实现了效率与视觉效果的双重提升。

摘要:

尽管DALL-E 3凭借从文本描述生成创意复杂图像的能力受到广泛欢迎,但其在风格迁移领域的应用仍有待深入探索。本项目研究了DALL-E 3与传统神经风格迁移技术的整合,以评估生成的风格图像对最终输出质量的影响。研究采用DALL-E 3根据提供的描述生成风格图像,并将其与Magenta Arbitrary Image Stylization(麦哲伦任意图像风格化)模型相结合。研究通过结构相似性指数(SSIM)、峰值信噪比(PSNR)等指标以及处理时间评估对该整合方案进行评测。结果显示,DALL-E 3显著提升了风格化图像的多样性和艺术质量。尽管这一提升伴随着风格迁移时间的小幅增加,但数据表明这种权衡是值得的,因为使用DALL-E 3的总处理时间比传统方法快约2.5秒,使其成为兼具效率和视觉效果优势的选择。

英文摘要:

While DALL-E 3 has gained popularity for its ability to generate creative and complex images from textual descriptions, its application in the domain of style transfer remains slightly underexplored. This project investigates the integration of DALL-E 3 with traditional neural style transfer techniques to assess the impact of generated style images on the quality of the final output. DALL-E 3 was employed to generate style images based on the descriptions provided and combine these with the Magenta Arbitrary Image Stylization model. This integration is evaluated through metrics such as the Structural Similarity Index Measure (SSIM) and Peak Signal-to-Noise Ratio (PSNR), as well as processing time assessments. The findings reveal that DALL-E 3 significantly enhances the diversity and artistic quality of stylized images. Although this improvement comes with a slight increase in style transfer time, the data shows that this trade-off is worthwhile because the overall processing time with DALL-E 3 is about 2.5 seconds faster than traditional methods, making it both an efficient and visually superior option.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑