全局图像情感传递
Global Image Sentiment Transfer
摘要:
在计算机视觉领域中,传递图像的情感是一个尚未探索的研究课题。这项工作提出了一种新的框架,包括一个参考图像检索步骤和一个全球的情感转移步骤,根据一个给定的情感标签转移图像的情感。提出的图像检索算法是基于SSIM索引。与基于感知损失的算法相比,该算法检索到的参考图像更具有内容相关性。因此可以导致更好的图像情感传递结果。此外,我们提出了一个全局情感转移步骤,它采用了一种优化算法,迭代地转移情感的图像的基础上产生的Densenet121架构的特征图。本文提出的情感传递算法在保证输入图像内容结构完整的同时,能够传递图像的情感。定性和定量实验表明,该情感迁移框架比现有的艺术风格和真实感风格迁移算法更能生成细节丰富、准确可靠的情感迁移结果。
英文摘要:
Transferring the sentiment of an image is an unexplored research topic in the area of computer vision. This work proposes a novel framework consisting of a reference image retrieval step and a global sentiment transfer step to transfer sentiments of images according to a given sentiment tag. The proposed image retrieval algorithm is based on the SSIM index. The retrieved reference images by the proposed algorithm are more content-related against the algorithm based on the perceptual loss. Therefore can lead to a better image sentiment transfer result. In addition, we propose a global sentiment transfer step, which employs an optimization algorithm to iteratively transfer sentiment of images based on feature maps produced by the Densenet121 architecture. The proposed sentiment transfer algorithm can transfer the sentiment of images while ensuring the content structure of the input image intact. The qualitative and quantitative experiments demonstrate that the proposed sentiment transfer framework outperforms existing artistic and photorealistic style transfer algorithms in making reliable sentiment transfer results with rich and exact details.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。