arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2506.23908cs.AIcs.LG
收藏

超越统计学习:精确学习对通用智能至关重要

Beyond Statistical Learning: Exact Learning Is Essential for General Intelligence

Google DeepMind(谷歌DeepMind)

András György, Tor Lattimore, Nevena Lazić, Csaba Szepesvári

AI总结:

本文指出统计学习导致AI系统在演绎推理上不可靠,主张为实现可靠演绎推理,AI研究须从优化统计性能转向要求所有输入均正确的精确学习范式。

摘要:

可靠的演绎推理——从现有事实和规则中推导新知识的能力——是通用智能中一个无可争议的理想方面。尽管AI系统在数学和科学等领域取得了重大进展,特别是自transformer架构引入以来,但有充分文献证明,即使是最先进的尖端系统也经常且持续地在易于解决的演绎推理任务上失败。因此,这些系统无法实现具备可靠演绎推理能力的人工通用智能的梦想。我们认为,它们不可靠的行为是推动其发展的统计学习方法的后果。为了克服这一点,我们主张,要在基于学习的AI系统中实现可靠的演绎推理,研究人员必须从根本上从针对推理问题和算法任务上的分布优化统计性能,转向拥抱更雄心勃勃的精确学习范式,该范式要求在所有输入上均保持正确性。我们认为精确学习既至关重要又切实可行,并且这一雄心勃勃的目标应该指导算法设计。

英文摘要:

Sound deductive reasoning -- the ability to derive new knowledge from existing facts and rules -- is an indisputably desirable aspect of general intelligence. Despite the major advances of AI systems in areas such as math and science, especially since the introduction of transformer architectures, it is well-documented that even the most advanced frontier systems regularly and consistently falter on easily-solvable deductive reasoning tasks. Hence, these systems are unfit to fulfill the dream of achieving artificial general intelligence capable of sound deductive reasoning. We argue that their unsound behavior is a consequence of the statistical learning approach powering their development. To overcome this, we contend that to achieve reliable deductive reasoning in learning-based AI systems, researchers must fundamentally shift from optimizing for statistical performance against distributions on reasoning problems and algorithmic tasks to embracing the more ambitious exact learning paradigm, which demands correctness on all inputs. We argue that exact learning is both essential and possible, and that this ambitious objective should guide algorithm design.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑