arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1908.03000cs.CVcs.LG
收藏

神经网络的特征选择偏向于不太抽象的线索

Feature selection of neural networks is skewed towards the less abstract cue

University of Applied Sciences Koblenz(科布伦茨应用科学大学)

Marcell Wolnitza, Babette Dellen

摘要:

人工神经网络(ANN)已成为图像分类的重要工具,在研究和工业中有许多应用。然而,如何选择相关的图像特征以及数据属性如何影响这一过程在很大程度上仍然是未知的。特别是,我们感兴趣的抽象水平的图像线索与类成员关系的影响特征选择。我们进行实验与二进制图像,包含组合的线索,代表两个不同层次的抽象:一个是从一个随机分布的模式,其中类成员关系与统计的模式,其他一个组合的符号样的实体,其中的符号代码与类成员关系。当网络用两个线索同等重要的数据训练时,我们观察到较低抽象级别的线索,即,即使在具有许多层的网络中,模式也是学习的,而符号信息在很大程度上被忽略。只有当低级别线索的重要性低于高级别线索时,才能学习到类似符号的实体。这些发现提出了关于深度ANN学习的特征的相关性以及学习如何转向符号特征的重要问题。

英文摘要:

Artificial neural networks (ANNs) have become an important tool for image classification with many applications in research and industry. However, it remains largely unknown how relevant image features are selected and how data properties affect this process. In particular, we are interested whether the abstraction level of image cues correlating with class membership influences feature selection. We perform experiments with binary images that contain a combination of cues, representing two different levels of abstractions: one is a pattern drawn from a random distribution where class membership correlates with the statistics of the pattern, the other a combination of symbol-like entities, where the symbolic code correlates with class membership. When the network is trained with data in which both cues are equally significant, we observe that the cues at the lower abstraction level, i.e., the pattern, is learned, while the symbolic information is largely ignored, even in networks with many layers. Symbol-like entities are only learned if the importance of low-level cues is reduced compared to the high-level ones. These findings raise important questions about the relevance of features that are learned by deep ANNs and how learning could be shifted towards symbolic features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑