数据集：一个用于自然语言处理的社区图书馆
Datasets: A Community Library for Natural Language Processing
摘要：
随着研究人员提出新的任务、更大的模型和新的基准，公开的NLP数据集的规模、种类和数量迅速增长。Datasets是一个当代NLP的社区库，旨在支持这个生态系统。数据集旨在标准化终端用户界面、版本控制和文档，同时提供一个轻量级的前端，其行为类似于小型数据集和互联网规模的语料库。该库的设计采用了一种分布式的、社区驱动的方法来添加数据集和记录使用情况。经过一年的发展，该库现在包括650多个独特的数据集，有250多个贡献者，并帮助支持各种新颖的跨数据集研究项目和共享任务。该库可在https://github.com/huggingface/datasets上查阅。
英文摘要：
The scale, variety, and quantity of publicly-available NLP datasets has grown rapidly as researchers propose new tasks, larger models, and novel benchmarks. Datasets is a community library for contemporary NLP designed to support this ecosystem. Datasets aims to standardize end-user interfaces, versioning, and documentation, while providing a lightweight front-end that behaves similarly for small datasets as for internet-scale corpora. The design of the library incorporates a distributed, community-driven approach to adding datasets and documenting usage. After a year of development, the library now includes more than 650 unique datasets, has more than 250 contributors, and has helped support a variety of novel cross-dataset research projects and shared tasks. The library is available at https://github.com/huggingface/datasets.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
