arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2605.25596cs.CL

基于自监督语音模型的多语言音韵特征识别

Multilingual Phonological Feature Recognition with Self-Supervised Speech Models

Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Germany(埃森哲大学模式识别实验室,德国);GITA Lab. Facultad de Ingeniería. Universidad de Antioquia UdeA, Medellín, Colombia(安蒂亚大学工程学院GITA实验室,哥伦比亚)

Abner Hernandez, Tomás Arias-Vergara, Daiqi Liu, Andreas Maier, Paula Andrea Pérez-Toro

AI总结:

提出PhonoQ-2.0,一种基于自监督语音模型的多语言帧级音韵特征识别器,通过方式条件门控机制直接预测结构化特征向量,在域内和域外均优于CTC基线。

摘要:

音韵特征提供了语言通用且基于语言学的语音表示。我们提出PhonoQ-2.0,一种基于自监督语音模型构建的多语言帧级音韵特征识别器。该系统直接预测每帧的结构化22维特征向量,编码方式、元音质量、发音部位和清浊,而不是从音素输出中推导特征。为确保音韵上一致的预测,我们引入了一种方式条件门控机制,激活有效的特征组。在多种语言和语料库上评估,PhonoQ-2.0在域内平均宏F1为91.3%,域外为88.9%。与强CTC音素基线相比,它在域内平均获得+8.8 F1的持续提升,域外平均+8.6。在未见语言评估中,PhonoQ-2.0将宏F1从66.9%提高到73.6%(平均+6.7),最高提升达+10.8个百分点。

英文摘要:

Phonological features provide a language-general and linguistically grounded representation of speech. We present PhonoQ-2.0, a multilingual frame-level phonological feature recognizer built on self-supervised speech models. The system directly predicts a structured 22-dimensional feature vector per frame encoding manner, vowel quality, place, and voicing, instead of deriving features from phoneme outputs. To ensure phonologically coherent predictions, we introduce a manner-conditioned gating mechanism that activates valid feature groups. Evaluated across multiple languages and corpora, PhonoQ-2.0 achieves an average macro-F1 of 91.3% in-domain and 88.9% out-of-domain. Compared to a strong CTC phoneme baseline, it delivers consistent gains of +8.8 F1 in-domain and +8.6 out-of-domain on average. In unseen-language evaluation, PhonoQ-2.0 improves macro-F1 from 66.9% to 73.6% (+6.7 on average), with gains of up to +10.8 points.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑