ARC-AGI无需预训练
ARC-AGI Without Pretraining
AI总结:
CompressARC通过最小化描述长度(MDL)在无需预训练的情况下解决ARC-AGI谜题,展示了深度学习在极低数据条件下产生智能的可行性。
摘要:
在大规模语言模型的时代,传统观点认为解决ARC-AGI-1基准中的类似智商测试的视觉谜题需要来自大规模预训练的能力。为了反驳这一点,我们引入了CompressARC,一个仅有76000个参数的模型,无需任何预训练,在推理时间期间通过最小化目标谜题的描述长度(MDL)来解决20%的评估谜题。MDL赋予CompressARC极强的泛化能力,这在深度学习中通常是听不到的。据我们所知,CompressARC是唯一一个在ARC-AGI上仅在单个样本(即目标推理谜题本身)上进行训练的深度学习方法,且最终的解决方案信息被移除。此外,CompressARC并不在预提供的ARC-AGI
英文摘要:
Conventional wisdom in the age of LLMs dictates that solving IQ-test-like visual puzzles from the ARC-AGI-1 benchmark requires capabilities derived from massive pretraining. To counter this, we introduce CompressARC, a 76K parameter model without any pretraining that solves 20% of evaluation puzzles by minimizing the description length (MDL) of the target puzzle purely during inference time. The MDL endows CompressARC with extreme generalization abilities typically unheard of in deep learning. To our knowledge, CompressARC is the only deep learning method for ARC-AGI where training happens only on a single sample: the target inference puzzle itself, with the final solution information removed. Moreover, CompressARC does not train on the pre-provided ARC-AGI "training set". Under these extremely data-limited conditions, we do not ordinarily expect any puzzles to be solvable at all. Yet CompressARC still solves a diverse distribution of creative ARC-AGI puzzles, suggesting MDL to be an alternative feasible way to produce intelligence, besides conventional pretraining.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。