arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.01093cs.CV
收藏

博物馆展品识别对领域自适应的挑战

Museum Exhibit Identification Challenge for Domain Adaptation and Beyond

Data61/CSIRO(数据61/英联邦科学与工业研究组织);Australian National University(澳大利亚国立大学);Hubei University of Arts and Science(湖北文理学院)

Piotr Koniusz, Yusuf Tas, Hongguang Zhang, Mehrtash Harandi, Fatih Porikli, Rui Zhang

摘要:

在本文中,我们探讨了一个开放的艺术品识别问题,并提出了一个新的数据集称为开放博物馆识别挑战(Open MIC)。它包含了在几个博物馆的10个不同展览空间拍摄的展品照片,这些展览空间展示了绘画、钟表、雕塑、玻璃器皿、文物、科学展品、自然历史作品、陶瓷、陶器、工具和土著工艺品。Open MIC的目标是通过提供一个与著名的Office数据集互补的测试平台来刺激领域自适应、自我中心识别和少样本学习方面的研究,该数据集的准确率达到90%。为了形成我们的数据集,我们用手机和可穿戴相机捕获了每件艺术品的许多图像,分别形成源数据和目标数据。为了实现鲁棒的基线,我们建立在最近的方法上,该方法对齐源和目标CNN流的每类散布矩阵[15]。此外,我们利用端到端的Bregman分歧和黎曼度量的这种表示的正定性质。我们提出了基线,如每个展览的培训/评估和涵盖866个展览身份的组合集的培训/评估。由于每个展览都提出了不同的挑战,例如,照明质量、运动模糊、遮挡、杂乱、视点和比例变化、旋转、眩光、透明度、非平面性、剪切,我们将结果分解为w.r.t.这些因素。

英文摘要:

In this paper, we approach an open problem of artwork identification and propose a new dataset dubbed Open Museum Identification Challenge (Open MIC). It contains photos of exhibits captured in 10 distinct exhibition spaces of several museums which showcase paintings, timepieces, sculptures, glassware, relics, science exhibits, natural history pieces, ceramics, pottery, tools and indigenous crafts. The goal of Open MIC is to stimulate research in domain adaptation, egocentric recognition and few-shot learning by providing a testbed complementary to the famous Office dataset which reaches 90% accuracy. To form our dataset, we captured a number of images per art piece with a mobile phone and wearable cameras to form the source and target data splits, respectively. To achieve robust baselines, we build on a recent approach that aligns per-class scatter matrices of the source and target CNN streams [15]. Moreover, we exploit the positive definite nature of such representations by using end-to-end Bregman divergences and the Riemannian metric. We present baselines such as training/evaluation per exhibition and training/evaluation on the combined set covering 866 exhibit identities. As each exhibition poses distinct challenges e.g., quality of lighting, motion blur, occlusions, clutter, viewpoint and scale variations, rotations, glares, transparency, non-planarity, clipping, we break down results w.r.t. these factors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑