Sequence-to-sequence models provide a simple and elegant solution for building speech recognition systems by folding separate components of a typical system, namely acoustic (AM), pronunciation (PM) and language (LM) models into a single neural network. In this work, we look at one such sequence-to-sequence model, namely listen, attend and spell (LAS), and explore the possibility of training a single model to serve different English dialects, which simplifies the process of training multi-dialect systems without the need for separate AM, PM and LMs for each dialect. We show that simply pooling the data from all dialects into one LAS model falls behind the performance of a model fine-tuned on each dialect. We then look at incorporating dialect-specific information into the model, both by modifying the training targets by inserting the dialect symbol at the end of the original grapheme sequence and also feeding a 1-hot representation of the dialect information into all layers of the model. Experimental results on seven English dialects show that our proposed system is effective in modeling dialect variations within a single LAS model, outperforming a LAS model trained individually on each of the seven dialects by 3.1 ~ 16.5% relative.
State-Space Models in Efficient Whispered and Multi-dialect Speech Recognition
Department of Computational Linguistics(计算语言学系);Recognition Technologies(语音识别技术);Faculty of New Sciences and Technologies(新科学与技术学院);Faculty of New Sciences(新科学学院)
Overcoming Data Scarcity in Multi-Dialectal Arabic ASR via Whisper Fine-Tuning
Department of Internal Medicine, Division of Nephrology(内科学部,肾病科);Bernoulli Institute for Mathematics, Computer Science(伯努利数学、计算机科学研究所);Speech Technology Lab, Campus Fryslân(语音技术实验室,弗里西恩校区)
CAFE A Novel Code switching Dataset for Algerian Dialect French and English
University of Bouira(布维拉大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Qatar Computing and Research Institute (HBKU)(卡塔尔计算与研究所(HBKU))
Efficient Dialect-Aware Modeling and Conditioning for Low-Resource Taiwanese Hakka Speech Processing
Dept. Computer Science and Information Engineering, National Taiwan Normal University, Taiwan(计算机科学与信息工程系,国立台湾师范大学,台湾);Institute of Computer Science, Academia Sinica, Taiwan(学术院计算机科学研究所,台湾);United Link Co., Ltd., Taiwan(联合链接公司,台湾)
NADI 2025: The First Multidialectal Arabic Speech Processing Shared Task
The University of British Columbia(不列颠哥伦比亚大学);Hamad Bin Khalifa University(哈马德·本·卡伊夫大学);Birzeit University(伯莱兹大学);MBZUAI(穆罕默德·本·拉希德智能科学与技术研究院);NYU Abu Dhabi(纽约大学阿布扎克分校)
LPC Augment: An LPC-Based ASR Data Augmentation Algorithm for Low and Zero-Resource Children's Dialects
University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Georgia State University(佐治亚州立大学)
本文提出了一种新的基于线性预测编码的儿童低资源和零资源方言ASR数据增强方法。数据增强过程包括在LPC分析和重建期间扰动LPC频谱的共振峰。该方法进行了评估两个新的儿童的语音数据集,其中一个包含加州英语从Southern California Area和其他包含混合的美国南部英语和非洲裔美国人的英语从亚特兰大,佐治亚州地区。我们在训练HMM-DNN系统和端到端系统时测试了所提出的方法,以显示模型的鲁棒性,并证明该算法与常见的数据增强方法(如VTLP,Speed Perturbation和SpecAugment)相比,提高了ASR性能,特别是对于零资源方言儿童任务。
Evaluating Standard and Dialectal Frisian ASR: Multilingual Fine-tuning and Language Identification for Improved Low-resource Performance
Center for Language and Cognition(语言与认知中心);University of Groningen(格罗宁根大学);Mercator European Research Centre(默卡托欧洲研究中心);Fryske Akademy(弗里斯克学院);Speech Technology Lab(语音技术实验室)
Accent-Invariant Automatic Speech Recognition via Saliency-Driven Spectrogram Masking
Department of Computer Engineering, Sharif University of Technology(谢里夫理工大学计算机工程系);Department of Computer Engineering, University of Tehran(德黑兰大学计算机工程系)
VoxCog: Towards End-to-End Multilingual Cognitive Impairment Classification through Dialectal Knowledge
Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California(明斯希德电气与计算机工程系,南加州大学);Dornsife College of Letters, Arts and Sciences, University of Southern California(多恩斯菲学院,南加州大学)
Cross-Dialect Bird Species Recognition with Dialect-Calibrated Augmentation
GLAM, Department of Computing, Imperial College London, UK(GLAM,计算系,帝国理工学院伦敦校区,英国);CHI - Chair of Health Informatics, TUM University Hospital, Munich, Germany(健康信息学主席,技术大学慕尼黑医院,慕尼黑,德国);MDSI – Munich Data Science Institute, Munich, Germany(慕尼黑数据科学研究所,慕尼黑,德国);MCML – Munich Center for Machine Learning, Munich, Germany(慕尼黑机器学习中心,慕尼黑,德国)
DB3V: A Dialect Dominated Dataset of Bird Vocalisation for Cross-corpus Bird Species Recognition
University of Augsburg(奥格斯堡大学);Beijing Forestry University(北京林业大学);Technical University of Munich(慕尼黑工业大学);Hume AI(休谟人工智能公司);Imperial College London(伦敦帝国理工学院);Munich Data Science Institute(慕尼黑数据科学研究所);Munich Center for Machine Learning(慕尼黑机器学习中心)
From `Snippet-lects' to Doculects and Dialects: Leveraging Neural Representations of Speech for Placing Audio Signals in a Language Landscape
Langues et Civilisations à Tradition Orale (LACITO)(口头传统语言与文明研究所(LACITO));CNRS(法国国家科学研究中心);Université Sorbonne Nouvelle(索邦新大学);Institut National des Langues et Civilisations Orientales (INALCO)(法国国立东方语言文化学院(INALCO));Université de Paris Cité(巴黎西岱大学);Laboratoire de Linguistique Formelle (LLF)(形式语言学实验室(LLF))
Identifying Primary Stress Across Related Languages and Dialects with Transformer-based Speech Encoder Models
Jožef Stefan Institute(乔塞夫·斯塔芬研究所);Slovenia University of Ljubljana(斯洛文尼亚卢布尔雅那大学);Department of Knowledge Technologies(知识技术系);Faculty of Computer and Information Science(计算机与信息科学学院);Institute of Contemporary History(现代史研究所)