arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.13233cs.LGcs.AIcs.RO
收藏

AI中的后选择以及如何避免它们

Post-Selections in AI and How to Avoid Them

GENISAMA LLC(GENISAMA有限责任公司);Michigan State University(密歇根州立大学)

Juyang Weng

摘要:

基于神经网络的人工智能(AI)在实验中的规模越来越大。然而,本文提出了一个很少报告的阶段,在这样的实验称为后选择改变读者几个可能的协议缺陷,可能会导致误导性的结果。所有的人工智能方法分为两大流派,联结主义和符号主义。后选择分为两种,后选择使用验证集(PSUVS)和后选择使用测试集(PSUTS)。每种都有两种类型的后选择器,机器和人类。联结主义学派因其“黑箱”和现在的后选择而受到批评;但看似“干净”的象征主义学派似乎更脆弱,因为它的人类PSUTS。本文首先提出了一个有争议的观点:所有静态的“大数据”都是不可扩展的。然后,我们分析了为什么随机初始化权重的错误反向传播会出现严重的局部最小值,为什么PSUVS缺乏交叉验证,为什么PSUTS违反了既定的协议,以及为什么涉及的每篇论文都应该透明地报告后选择阶段。为了避免未来人工智能竞赛中的陷阱,本文提出了一种新的人工智能指标,即在三种学习条件下训练的所有网络的发育错误:(1)增量学习架构(由于“大数据”缺陷),(2)训练经验和(3)有限的计算资源。发展网络避免了后选择,因为它们通过生成涌现的图灵机(而不是黑盒子)来自动发现动态的上下文规则,这些图灵机在三个学习条件下,在整个生命周期的最大可能性意义上是最优的。

英文摘要:

Neural network based Artificial Intelligence (AI) has reported increasing scales in experiments. However, this paper raises a rarely reported stage in such experiments called Post-Selection alter the reader to several possible protocol flaws that may result in misleading results. All AI methods fall into two broad schools, connectionist and symbolic. The Post-Selection fall into two kinds, Post-Selection Using Validation Sets (PSUVS) and Post-Selection Using Test Sets (PSUTS). Each kind has two types of post-selectors, machines and humans. The connectionist school received criticisms for its "black box" and now the Post-Selection; but the seemingly "clean" symbolic school seems more brittle because of its human PSUTS. This paper first presents a controversial view: all static "big data" are non-scalable. We then analyze why error-backprop from randomly initialized weights suffers from severe local minima, why PSUVS lacks cross-validation, why PSUTS violates well-established protocols, and why every paper involved should transparently report the Post-Selection stage. To avoid future pitfalls in AI competitions, this paper proposes a new AI metrics, called developmental errors for all networks trained, under Three Learning Conditions: (1) an incremental learning architecture (due to a "big data" flaw), (2) a training experience and (3) a limited amount of computational resources. Developmental Networks avoid Post-Selections because they automatically discover context-rules on the fly by generating emergent Turing machines (not black boxes) that are optimal in the sense of maximum-likelihood across lifetime, conditioned on the Three Learning Conditions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑