arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.10240cs.CV
收藏

神经美学图像审查器

Neural Aesthetic Image Reviewer

Fudan University(复旦大学);Xi’an University of Technology(西安理工大学);China University of Petroleum(中国石油大学)

Wenshan Wang, Su Yang, Weishan Zhang, Jiulong Zhang

摘要:

近年来,人们对图像美学的关注日益高涨。现有的作品处理图像美学作为一个分类或回归问题。为了将认知从评级扩展到推理,对美学的更深入理解应该基于揭示为什么应该为图像分配高或低的美学分数。从这个角度来看,我们提出了一个模型称为神经美学图像评论器,它不仅可以给一个图像的美学评分,但也产生一个文本描述解释为什么图像导致一个合理的评级分数。具体来说,我们提出了两个多任务架构的基础上共享的美学语义层和特定于任务的嵌入层在一个高层次上的性能提高不同的任务。为了方便对该问题的研究,我们收集了AVA-Reviews数据集,该数据集总共包含52,118张图像和312,708条评论。通过多任务学习,所提出的模型可以对美学图像进行评级,并以端到端的方式生成评论。根据对AVA-Reviews数据集的性能评估,证实了所提出的模型优于基线。此外,我们通过实验证明,我们的模型可以生成与美学相关的文本评论,这与人类的感知是一致的。

英文摘要:

Recently, there is a rising interest in perceiving image aesthetics. The existing works deal with image aesthetics as a classification or regression problem. To extend the cognition from rating to reasoning, a deeper understanding of aesthetics should be based on revealing why a high- or low-aesthetic score should be assigned to an image. From such a point of view, we propose a model referred to as Neural Aesthetic Image Reviewer, which can not only give an aesthetic score for an image, but also generate a textual description explaining why the image leads to a plausible rating score. Specifically, we propose two multi-task architectures based on shared aesthetically semantic layers and task-specific embedding layers at a high level for performance improvement on different tasks. To facilitate researches on this problem, we collect the AVA-Reviews dataset, which contains 52,118 images and 312,708 comments in total. Through multi-task learning, the proposed models can rate aesthetic images as well as produce comments in an end-to-end manner. It is confirmed that the proposed models outperform the baselines according to the performance evaluation on the AVA-Reviews dataset. Moreover, we demonstrate experimentally that our model can generate textual reviews related to aesthetics, which are consistent with human perception.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑