arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.14852cs.AI
收藏

TACO:算法代码生成数据集中的主题

TACO: Topics in Algorithmic COde generation dataset

Beijing Academy of Artificial Intelligence(北京人工智能研究院);School of Information Science and Engineering, Shandong Normal University(山东师范大学信息科学与工程学院);Peking University(北京大学)

Rongao Li, Jie Fu, Bo-Wen Zhang, Tao Huang, Zhihong Sun, Chen Lyu, Guang Liu, Zhi Jin, Ge Li

AI总结:

TACO是一个开源的大规模代码生成数据集,包含竞赛级编程问题,提供细粒度标签和多样化解决方案,用于提升和评估代码生成模型的问题理解和推理能力。

摘要:

我们介绍了TACO,一个开源的大规模代码生成数据集,重点关注算法的视角,旨在为代码生成模型领域提供更具挑战性的训练数据集和评估基准。TACO包含更具挑战性的竞赛级编程问题,以增强或评估在真实编程场景中的问题理解和推理能力。训练集和测试集中分别有25433个和1000个编码问题,以及多达155万个多样化的解决方案答案。此外,每个TACO问题都包含多个细粒度标签,如任务主题、算法、编程技能和难度级别,为代码生成模型的训练和评估提供了更精确的参考。该数据集和评估脚本可在Hugging Face Hub(https://huggingface.co/datasets/BAAI/TACO)和Github(https://github.com/FlagOpen/TACO)上获取。

英文摘要:

We introduce TACO, an open-source, large-scale code generation dataset, with a focus on the optics of algorithms, designed to provide a more challenging training dataset and evaluation benchmark in the field of code generation models. TACO includes competition-level programming questions that are more challenging, to enhance or evaluate problem understanding and reasoning abilities in real-world programming scenarios. There are 25433 and 1000 coding problems in training and test set, as well as up to 1.55 million diverse solution answers. Moreover, each TACO problem includes several fine-grained labels such as task topics, algorithms, programming skills, and difficulty levels, providing a more precise reference for the training and evaluation of code generation models. The dataset and evaluation scripts are available on Hugging Face Hub (https://huggingface.co/datasets/BAAI/TACO) and Github (https://github.com/FlagOpen/TACO).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑