We investigate recent transformer networks pre-trained for automatic speech recognition for their ability to detect speaker and language changes in speech. We do this by simply adding speaker (change) or language targets to the labels. For Wav2vec2 pre-trained networks, we also investigate if the representation for the speaker change symbol can be conditioned to capture speaker identity characteristics. Using a number of constructed data sets we show that these capabilities are definitely there, with speaker recognition equal error rates of the order of 10% and language detection error rates of a few percent. We will publish the code for reproducibility.
Perceiver-Prompt: Flexible Speaker Adaptation in Whisper for Chinese Disordered Speech Recognition
Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所）；The Chinese University of Hong Kong（香港中文大学）；Shenzhen Institute of Advanced Technology, CAS（中国科学院深圳先进技术研究院）；University of Chinese Academy of Sciences（中国科学院大学）
End-to-End Joint ASR and Speaker Role Diarization with Child-Adult Interactions
Viterbi School of Engineering, University of Southern California, US（维特比工程学院，南加州大学）；Weill Institute for Neurosciences, University of California, San Francisco, US（韦尔神经科学研究所，旧金山大学）；David Geffen School of Medicine, University of California, Los Angeles, US（大卫·盖芬医学院，洛杉矶大学）
Towards Fair ASR For Second Language Speakers Using Fairness Prompted Finetuning
Johannes Kepler University Linz, Austria（奥地利林茨约翰内斯·开普勒大学）；IIT Kharagpur, India（印度德里理工学院）；University of Eastern Finland（芬兰东部理工大学）；University of Copenhagen（丹麦哥本哈根大学）；Aalborg University（丹麦奥胡斯大学）
Deterministic Prompting for Speaker-Stable Low-Resource Greek TTS
Institute for Language and Speech Processing, Athena R.C.（雅典娜研究与创新中心语言与语音处理研究所）；Department of Digital Medicine, University of Bern（伯尔尼大学数字医学系）；School of Electrical and Computer Engineering, National Technical University of Athens（雅典国家技术大学电气与计算机工程学院）
Scaling Multi-Talker ASR with Speaker-Agnostic Activity Streams
Department of Computer Science, Johns Hopkins University（约翰霍普金斯大学计算机科学系）；Faculty of Information Technology, Brno University of Technology（布拉格技术大学信息科技学院）；Human Language Technology Center of Excellence, Johns Hopkins University（约翰霍普金斯大学人机语言技术中心卓越中心）
Elderly-Contextual Data Augmentation via Speech Synthesis for Elderly ASR
Department of Computer Science and Artificial Intelligence, Dongguk University（计算机科学与人工智能系，东国大学）；Department of Biostatistics, Harvard University（生物统计学系，哈佛大学）
Speech Intelligibility Assessment with Uncertainty-Aware Whisper Embeddings and sLSTM
Research Center for Information Technology Innovation, Academia Sinica（资讯科技创新研究中心，学术院）；Social Network and Human Centered Computing, Institute of Information Science, Academia Sinica（社交网络与人本计算，信息科学研究所，学术院）；Institute of Information Science, Academia Sinica（信息科学研究所，学术院）
Understanding Multilingual Medical ASR Adaptation Through Layer-Wise Analysis
Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU)（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；University of Sheffield（谢菲尔德大学）；Technical University of Munich (TUM)（慕尼黑工业大学）
myMediWhisper: Construction of Burmese Medical Speech Corpus and Whisper Fine-Tuning for Clinical Dialogue ASR
National Electronics and Computer Technology Center (NECTEC)（国家电子与计算机技术中心）；King Mongkut’s University of Technology Thonburi（国王蒙固科技大学吞武里分校）；King Mongkut’s Institute of Technology Ladkrabang（国王蒙固科技学院叻甲邦分校）
BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communications
Idiap Research Institute（伊迪亚普研究所）；Ecole Polytechnique Federale de Lausanne (EPFL)（洛桑联邦理工学院）；Brno University of Technology（布尔诺理工大学）；German Aerospace Center (DLR)（德国航空航天中心）
Layer-wise Probing of wav2vec 2.0 and Whisper for Consonant Cluster Reduction in African American English
Department of English Language and Linguistics, Institute of English and American Studies, Faculty of Arts and Humanities, Heinrich Heine University Düsseldorf, Germany（海因里希·海涅大学杜塞尔多夫分校，人文与艺术学院，英美研究学院，英语语言与语言学系）；Department of Linguistics, University of Florida, United States of America（佛罗里达大学语言学系）
