arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.14035cs.CLcs.AI
收藏

The ROOTS Search Tool:LLM的数据透明性

The ROOTS Search Tool: Data Transparency for LLMs

Hugging Face;Sapienza University(罗马第一大学(萨皮恩扎大学));Leipzig University(莱比锡大学);Telefonica I+D(西班牙电信研发公司);Mavenoid;University of Copenhagen(哥本哈根大学)

Aleksandra Piktus, Christopher Akiki, Paulo Villegas, Hugo Laurençon, Gérard Dupont, Alexandra Sasha Luccioni, Yacine Jernite, Anna Rogers

摘要:

ROOTS是一个1.6TB的多语言文本语料库,为BLOOM的培训而开发,目前是最大的语言模型,明确地伴随着相应的数据治理工作。在继续这些努力,我们提出了根搜索工具:一个搜索引擎在整个根语料库提供模糊和准确的搜索能力。根是迄今为止最大的语料库,可以调查这种方式。ROOTS搜索工具是开源的,可在Hugging Face Spaces上使用。我们描述了我们的实现和我们的工具的可能用例。

英文摘要:

ROOTS is a 1.6TB multilingual text corpus developed for the training of BLOOM, currently the largest language model explicitly accompanied by commensurate data governance efforts. In continuation of these efforts, we present the ROOTS Search Tool: a search engine over the entire ROOTS corpus offering both fuzzy and exact search capabilities. ROOTS is the largest corpus to date that can be investigated this way. The ROOTS Search Tool is open-sourced and available on Hugging Face Spaces. We describe our implementation and the possible use cases of our tool.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑