arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1909.01040cs.CVcs.LGeess.IV
收藏

一种几何敏感的摄影风格分类方法

A Geometry-Sensitive Approach for Photographic Style Classification

Trinity College Dublin(都柏林圣三一学院);Daedalean

Koustav Ghosal, Mukta Prasad, Aljosa Smolic

摘要:

照片的特点是不同的组成属性,如三分之一规则,景深,消失线等的存在或不存在的一个或多个这些属性有助于图像的整体艺术价值。在这项工作中,我们分析了基于深度学习的方法学习这种摄影风格属性的能力。我们观察到,尽管标准的CNN可以很好地学习基于纹理和外观的特征,但它对全局和几何特征的理解受到两个因素的限制。首先,数据扩充策略(裁剪、扭曲等)扭曲照片的构图并影响表现。其次,原则上,CNN特征是不变性的并且依赖于外观。但是一些对美学很重要的几何性质,例如三分之一法则(RoT),是位置相关的和外观不变的。因此,我们提出了一种新的输入表示,这是几何敏感,位置认知和外观不变。我们进一步介绍了一个两列的CNN架构,在摄影风格分类方面比最先进的(SoA)表现得更好。从我们的结果中,我们观察到,所提出的网络学习的几何和外观为基础的属性比SoA更好。

英文摘要:

Photographs are characterized by different compositional attributes like the Rule of Thirds, depth of field, vanishing-lines etc. The presence or absence of one or more of these attributes contributes to the overall artistic value of an image. In this work, we analyze the ability of deep learning based methods to learn such photographic style attributes. We observe that although a standard CNN learns the texture and appearance based features reasonably well, its understanding of global and geometric features is limited by two factors. First, the data-augmentation strategies (cropping, warping, etc.) distort the composition of a photograph and affect the performance. Secondly, the CNN features, in principle, are translation-invariant and appearance-dependent. But some geometric properties important for aesthetics, e.g. the Rule of Thirds (RoT), are position-dependent and appearance-invariant. Therefore, we propose a novel input representation which is geometry-sensitive, position-cognizant and appearance-invariant. We further introduce a two-column CNN architecture that performs better than the state-of-the-art (SoA) in photographic style classification. From our results, we observe that the proposed network learns both the geometric and appearance-based attributes better than the SoA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑