复杂性度量与概念学习
Complexity Measures and Concept Learning
摘要:
概念学习的本质是认知科学的核心问题。理论必须考虑到受监督的学习者获得不同概念的相对困难。对于一个包含六种类别类型的规范集合,我们发现了两种不同的分类难度排序:一种是我们称之为范式特定的排序,它发生在成年人类学习者对具有容易区分的特征(如大小、形状和阴影)的对象进行分类时。一般顺序发生在所有其他已知的情况下:当成年人对具有不容易区分的特征的物体进行分类时(例如,亮度,饱和度,色调);儿童和猴子;分类困难是从识别学习中的错误推断出来的。通过测量任务的逻辑复杂性,发现范式特定顺序在数学上是可预测的,即,解决方案如何简洁地用逻辑规则来表示。然而,逻辑复杂性只解释了范式特定的顺序,而不是一般的顺序。在这里,我们提出了一个新的难度测量,信息复杂性,计算剩余的不确定性的数量时,指定的一个子集的尺寸。这种测量是基于香农熵。我们发现,当度量提取最小的不确定性,这种新的测量预测的范式特定的顺序为典型的六个类别类型,当度量提取平均不确定性,这种新的测量预测的一般顺序。此外,对于学习类别类型超过规范六,我们发现,最小不确定性制定正确预测的范式特定的顺序以及或更好地比现有的指标(布尔复杂性和GIST)在大多数情况下。
英文摘要:
The nature of concept learning is a core question in cognitive science. Theories must account for the relative difficulty of acquiring different concepts by supervised learners. For a canonical set of six category types, two distinct orderings of classification difficulty have been found. One ordering, which we call paradigm-specific, occurs when adult human learners classify objects with easily distinguishable characteristics such as size, shape, and shading. The general order occurs in all other known cases: when adult humans classify objects with characteristics that are not readily distinguished (e.g., brightness, saturation, hue); for children and monkeys; and when categorization difficulty is extrapolated from errors in identification learning. The paradigm-specific order was found to be predictable mathematically by measuring the logical complexity of tasks, i.e., how concisely the solution can be represented by logical rules. However, logical complexity explains only the paradigm-specific order but not the general order. Here we propose a new difficulty measurement, information complexity, that calculates the amount of uncertainty remaining when a subset of the dimensions are specified. This measurement is based on Shannon entropy. We show that, when the metric extracts minimal uncertainties, this new measurement predicts the paradigm-specific order for the canonical six category types, and when the metric extracts average uncertainties, this new measurement predicts the general order. Moreover, for learning category types beyond the canonical six, we find that the minimal-uncertainty formulation correctly predicts the paradigm-specific order as well or better than existing metrics (Boolean complexity and GIST) in most cases.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。