textless-lib: a Library for Textless Spoken Language Processing
Meta AI Research(Meta AI 研究院);EHESS(法国社会科学高等研究院);Outreach(外展(可能指外展团队,但按要求提取到机构级别,这里Outreach可能是团队名,非独立机构,故不提取))
Eugene Kharitonov, Jade Copet, Kushal Lakhotia, Tu Anh Nguyen, Paden Tomasello, Ann Lee, Ali Elkahky, Wei-Ning Hsu, Abdelrahman Mohamed, Emmanuel Dupoux, Yossi Adi
Textless spoken language processing research aims to extend the applicability of standard NLP toolset onto spoken language and languages with few or no textual resources. In this paper, we introduce textless-lib, a PyTorch-based library aimed to facilitate research in this research area. We describe the building blocks that the library provides and demonstrate its usability by discuss three different use-case examples: (i) speaker probing, (ii) speech resynthesis and compression, and (iii) speech continuation. We believe that textless-lib substantially simplifies research the textless setting and will be handful not only for speech researchers but also for the NLP community at large. The code, documentation, and pre-trained models are available at https://github.com/facebookresearch/textlesslib/ .
SLIDE: Integrating Speech Language Model with LLM for Spontaneous Spoken Dialogue Generation
Institute of Acoustics, Chinese Academy of Sciences(中国科学院声学研究所);University of Chinese Academy of Sciences(中国科学院大学);Guangdong Provincial Public Security Department(广东省公安厅);Shanghai Jiao Tong University(上海交通大学)
Avaya Conversational Intelligence: A Real-Time System for Spoken Language Understanding in Human-Human Call Center Conversations
Avaya(Avaya公司);Wrocław University of Science and Technology(弗罗茨瓦夫理工大学);Poznan University of Technology(波兹南理工大学);AGH University of Science and Technology(AGH科技大学)
口语翻译(spoken language translation,缩写为EMT)中的最近的工作已经尝试在学习或解码期间不使用源语言转录的情况下构建端到端的语音到文本的翻译。然而,虽然大量的并行文本(例如Europarl、OpenSubtitles)可用于训练机器翻译系统,但是不存在包括与目标语言的文本对齐的源语言的语音的大型(100 h)和开源并行语料库。本文试图填补这一空白,增加现有的(单语)语料库:LibriSpeech。该语料库用于自动语音识别,来自LibriVox项目的有声读物,并经过仔细的分段和对齐。在从LibriSpeech中收集与英语有声读物相对应的法语电子书后,我们将句子级别的语音片段与各自的翻译对齐,并获得236 h的可用并行数据。本文介绍了处理的细节,以及进行人工评估的一个小的子集的语料库。该评估表明,自动对齐分数与双语对齐质量的人类判断合理相关。我们相信,这个语料库(这是在线提供)是有用的直接语音翻译或更一般的口语翻译实验的可复制实验。
The Zero Resource Speech Challenge 2021: Spoken language modelling
University of Toronto(多伦多大学);Cognitive Machine Learning (ENS--CNRS--EHESS--INRIA--PSL Research University)(认知机器学习实验室(巴黎高等师范学院--法国国家科学研究中心--社会科学高等研究院--法国国家信息与自动化研究所--巴黎文理研究大学));Facebook AI Research(脸书人工智能研究院)
Applying Wav2vec2.0 to Speech Recognition in Various Low-resource Languages
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Ping An Technology (Shenzhen) Co., Ltd.(平安科技(深圳)有限公司)
Improved Contextual Recognition In Automatic Speech Recognition Systems By Semantic Lattice Rescoring
Purdue University(普渡大学);Carnegie Mellon University(卡内基梅隆大学);University of California Los Angeles(加州大学洛杉矶分校);McGill University(麦吉尔大学);Stanford University(斯坦福大学);Amazon AI(亚马逊人工智能)
本文提出结合 HMM-GMM、DNN 与 transformer 的语义词格重评分框架,以增强 ASR 的上下文识别并降低 WER,且在 LibriSpeech 上验证有效。