arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.02572eess.AScs.LGcs.SD
收藏

用于病理语音检测的自监督学习

Selfsupervised learning for pathological speech detection

Idiap Research Institute(伊迪亚普研究所)

Shakeel Ahmad Sheikh

AI总结:

针对病理语音检测中数据稀缺和诊断主观性问题,本文探讨了利用 wav2vec2 等自监督学习嵌入从音频提取丰富表示,以提升自动检测性能的潜在解决方案。

摘要:

语音产生是一个复杂的现象,大脑在此过程中协调一系列涉及思维处理、运动规划和发音动作执行的流程。然而,这种复杂流程的执行极易受到各种神经退行性病理语音障碍的影响和破坏,例如帕金森病,导致构音障碍、失用症和其他病症。这些障碍会导致以异常语音模式和发音不精确为特征的病理语音。在临床环境中诊断这些语音障碍通常涉及听觉感知测试,这非常耗时,并且诊断结果可能因临床医生在诊断过程中的经验、偏见和认知负荷而有所不同。此外,与神经典型说话者不同,患有语音病理或障碍的患者无法使用各种虚拟助手,如 Alexa、Siri 等。为了应对这些挑战,人们提出了几种自动病理语音检测(PSD)方法。这些方法旨在提供高效且准确的语音障碍检测,从而为受这些病症影响的个体提供及时的干预和支持。这些方法主要在两个方面有所不同:所使用的输入表示和所采用的分类器。由于数据可用性有限,检测性能仍然不佳。自监督学习(SSL)嵌入,例如 wav2vec2 及其多语言版本,正被探索作为提高性能的有前途的途径。这些嵌入利用自监督学习技术从音频数据中提取丰富的表示,从而为解决标记数据稀缺所带来的局限性提供潜在的解决方案。

英文摘要:

Speech production is a complex phenomenon, wherein the brain orchestrates a sequence of processes involving thought processing, motor planning, and the execution of articulatory movements. However, this intricate execution of various processes is susceptible to influence and disruption by various neurodegenerative pathological speech disorders, such as Parkinsons' disease, resulting in dysarthria, apraxia, and other conditions. These disorders lead to pathological speech characterized by abnormal speech patterns and imprecise articulation. Diagnosing these speech disorders in clinical settings typically involves auditory perceptual tests, which are time-consuming, and the diagnosis can vary among clinicians based on their experiences, biases, and cognitive load during the diagnosis. Additionally, unlike neurotypical speakers, patients with speech pathologies or impairments are unable to access various virtual assistants such as Alexa, Siri, etc. To address these challenges, several automatic pathological speech detection (PSD) approaches have been proposed. These approaches aim to provide efficient and accurate detection of speech disorders, thereby facilitating timely intervention and support for individuals affected by these conditions. These approaches mainly vary in two aspects: the input representations utilized and the classifiers employed. Due to the limited availability of data, the performance of detection remains subpar. Self-supervised learning (SSL) embeddings, such as wav2vec2, and their multilingual versions, are being explored as a promising avenue to improve performance. These embeddings leverage self-supervised learning techniques to extract rich representations from audio data, thereby offering a potential solution to address the limitations posed by the scarcity of labeled data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑