跨语言检索增强分类用于构音障碍严重程度评估
Cross-lingual Retrieval-Augmented Classification for Dysarthria Severity Assessment
AI总结:
提出跨语言检索增强分类(CRAC)方法,通过对齐-检索-融合流程利用另一种语言的语音数据,在说话人无关的三分类任务中,韩语和意大利语数据集上分别达到87.3%和86.7%的平衡准确率,比单语基线提升8.4和20.0个百分点。
摘要:
自动构音障碍严重程度评估受到标记病理语音数据稀缺的限制。为了解决这个问题,我们提出了跨语言检索增强分类(CRAC),它通过对齐-检索-融合流程利用来自不同语言的语音。监督对比学习首先塑造了一个以严重程度为中心的嵌入空间,然后从另一种语言语料库构建向量数据库。在训练和推理过程中,分类器从对齐空间中检索前k个参考,并通过交叉注意力将其与输入融合。在说话人独立的三分类协议下,对韩语中风后和意大利语ALS构音障碍数据集进行评估,CRAC在韩语上达到87.3%的平衡准确率,在意大利语上达到86.7%,分别比单语基线提高了8.4和20.0个百分点。
英文摘要:
Automatic dysarthria severity assessment is limited by the scarcity of labeled pathological speech data. To address this, we propose Cross-lingual Retrieval-Augmented Classification (CRAC), which leverages speech from a different language via an align-retrieve-fuse pipeline. Supervised contrastive learning first shapes a severity-focused embedding space, then a vector database is built from the opposite-language corpus. During both training and inference, the classifier retrieves top-k references from the aligned space and fuses them with the input via cross-attention. Evaluated on Korean post-stroke and Italian ALS dysarthria datasets under a speaker-independent three-class protocol, CRAC achieves balanced accuracies of 87.3% on Korean and 86.7% on Italian, improving over monolingual baselines by 8.4 and 20.0 percentage points, respectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。