arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.07359cs.CLcs.LGcs.SDeess.AS
收藏

textless-lib:一个无文本口语处理库

textless-lib: a Library for Textless Spoken Language Processing

Meta AI Research(Meta AI 研究院);EHESS(法国社会科学高等研究院);Outreach(外展(可能指外展团队,但按要求提取到机构级别,这里Outreach可能是团队名,非独立机构,故不提取))

Eugene Kharitonov, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Paden Tomasello, Ann Lee, Ali Elkahky, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi

摘要:

无文本口语处理研究旨在将标准NLP工具集的适用性扩展到口语和几乎没有文本资源的语言。在本文中,我们介绍了textless-lib,一个基于PyTorch的库,旨在促进这一研究领域的研究。我们描述了该库提供的构建块,并通过讨论三个不同的用例示例来展示其可用性:(i)扬声器探测,(ii)语音再合成和压缩,以及(iii)语音延续。我们相信,textless-lib大大简化了无文本环境下的研究,不仅对语音研究人员,而且对整个NLP社区来说都是少数。代码、文档和预训练模型可在https://github.com/facebookresearch/textlesslib/上获得。

英文摘要:

Textless spoken language processing research aims to extend the applicability of standard NLP toolset onto spoken language and languages with few or no textual resources. In this paper, we introduce textless-lib, a PyTorch-based library aimed to facilitate research in this research area. We describe the building blocks that the library provides and demonstrate its usability by discuss three different use-case examples: (i) speaker probing, (ii) speech resynthesis and compression, and (iii) speech continuation. We believe that textless-lib substantially simplifies research the textless setting and will be handful not only for speech researchers but also for the NLP community at large. The code, documentation, and pre-trained models are available at https://github.com/facebookresearch/textlesslib/ .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑