arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.07353cs.LGcs.AI
收藏

通过程序化样例生成解决Abstraction and Reasoning Corpus(抽象与推理语料库)问题

Addressing the Abstraction and Reasoning Corpus via Procedural Example Generation

Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所)

Michael Hodel

AI总结:

本研究针对ARC基准训练任务样例少、多样性有限的问题,通过逆向推导样例分布构建程序化生成器,解除原始样例的不必要约束以扩充样例空间,为在该基准上取得突破提供实验支撑。

摘要:

本研究提出了为ARC(Abstraction and Reasoning Corpus,抽象与推理语料库)训练任务程序化生成样例的代码。针对400项任务中的每一项,研究人员都创建了遵循原始样例转换逻辑的样例生成器。实际上,该研究通过实现一种采样方法,逆向推导出了任意给定任务假定的样例底层分布。研究尝试为每项任务覆盖尽可能大的合理可能样例空间。也就是说,当某一任务的原始样例存在多样性局限时——例如网格维度、符号集合或物体数量保持恒定或处于严格范围内(即便转换本身并不要求这类限制)——研究便解除了这些约束。与ARC中每项任务仅能获取少量样例的情况不同,获取大量样例将支持广泛的实验开展,而这些实验可能是在该基准上取得突破性进展的重要垫脚石。

英文摘要:

This work presents code to procedurally generate examples for the ARC training tasks. For each of the 400 tasks, an example generator following the transformation logic of the original examples was created. In effect, the assumed underlying distribution of examples for any given task was reverse engineered by implementing a means to sample from it. An attempt was made to cover an as large as reasonable space of possible examples for each task. That is, whenever the original examples of a given task may be limited in their diversity e.g. by having the dimensions of the grids, the set of symbols or number of objects constant or within tight bounds, even though the transformation does not require it, such constraints were lifted. Having access to not just a few examples per task, as the case for ARC, but instead very many, should enable a wide range of experiments that may be important stepping stones towards making leaps on the benchmark.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑