arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.09710cs.LGstat.ML
收藏

基于历时描述的绘画作品标签自动推荐

Automatic Tag Recommendation for Painting Artworks Using Diachronic Descriptions

UFMG(米纳斯吉拉斯联邦大学);Projeto Portinari(波尔蒂纳里项目);Kunumi

Gianlucca Zuin, Adriano Veloso, João Cândido Portinari, Nivio Ziviani

摘要:

在本文中,我们处理的问题,自动标签推荐绘画艺术品。历时性描述包含用于描述每幅画的词汇的偏差,通常发生在作品由许多专家随着时间的推移完成时。这项工作的目的是提供一个框架,产生一个更准确和均匀的一套标签的每一幅画在一个大的集合。为了验证我们的方法,我们建立了一个模型的基础上,弱监督神经网络的$5{,}300$绘画与手工标记的描述由专家为巴西画家波尔蒂纳里的绘画。这项工作发生在Portinari项目,该项目始于1979年,旨在恢复和编目巴西画家的画作。当时,波尔蒂纳里的画作被私人收藏,博物馆遍布世界各地,因此无法向公众开放。每幅画的描述都是由大量的合作者在40多年的时间里完成的,这些历时性的描述导致了用于描述每幅画的词汇的偏差。我们提出的框架包括:(i)一个神经网络,它接收每幅画的图像作为输入,并使用频繁项集作为可能的标签;以及(ii)一个聚类步骤,我们根据预先训练的分类器的输出对相关标签进行分组。

英文摘要:

In this paper, we deal with the problem of automatic tag recommendation for painting artworks. Diachronic descriptions containing deviations on the vocabulary used to describe each painting usually occur when the work is done by many experts over time. The objective of this work is to provide a framework that produces a more accurate and homogeneous set of tags for each painting in a large collection. To validate our method we build a model based on a weakly-supervised neural network for over $5{,}300$ paintings with hand-labeled descriptions made by experts for the paintings of the Brazilian painter Candido Portinari. This work takes place with the Portinari Project which started in 1979 intending to recover and catalog the paintings of the Brazilian painter. The Portinari paintings at that time were in private collections and museums spread around the world and thus inaccessible to the public. The descriptions of each painting were made by a large number of collaborators over 40 years as the paintings were recovered and these diachronic descriptions caused deviations on the vocabulary used to describe each painting. Our proposed framework consists of (i) a neural network that receives as input the image of each painting and uses frequent itemsets as possible tags, and (ii) a clustering step in which we group related tags based on the output of the pre-trained classifiers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑