arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.03283eess.AS
收藏

基于深度学习的构音障碍语音检测的STFT相位表示实验研究

Experimental investigation on STFT phase representations for deep learning-based dysarthric speech detection

Parvaneh Janbakhshi, Ina Kodrasi

摘要:

主流的基于深度学习的构音障碍语音检测方法通常依赖于处理输入信号的短时傅里叶变换的幅度谱,而忽略相位谱。虽然可以从幅度谱中获得关于信号结构的相当多的见解,但是相位谱也包含由于相位不连续而不能立即显现的固有结构。为了揭示有意义的相位结构,替代相位表示,如修改的群延迟(MGD)和瞬时频率(IF)谱已在几个应用中进行了研究。本文的目的是调查的适用性的未处理阶段,MGD,和IF频谱构音障碍的语音检测。实验结果表明,构音障碍的线索存在于所有考虑的相位表示。此外,还表明使用相位表示作为幅度谱的补充特征有利于基于深度学习的构音障碍语音检测,幅度谱和IF谱的组合可产生高性能。所提出的结果应提高认识,在研究界的相位谱构音障碍语音检测的潜力,并激励研究到新的架构,最佳利用幅度和相位信息。

英文摘要:

Mainstream deep learning-based dysarthric speech detection approaches typically rely on processing the magnitude spectrum of the short-time Fourier transform of input signals, while ignoring the phase spectrum. Although considerable insight about the structure of a signal can be obtained from the magnitude spectrum, the phase spectrum also contains inherent structures which are not immediately apparent due to phase discontinuity. To reveal meaningful phase structures, alternative phase representations such as the modified group delay (MGD) and instantaneous frequency (IF) spectra have been investigated in several applications. The objective of this paper is to investigate the applicability of the unprocessed phase, MGD, and IF spectra for dysarthric speech detection. Experimental results show that dysarthric cues are present in all considered phase representations. Further, it is shown that using phase representations as complementary features to the magnitude spectrum is beneficial for deep learning-based dysarthric speech detection, with the combination of magnitude and IF spectra yielding a high performance. The presented results should raise awareness in the research community about the potential of the phase spectrum for dysarthric speech detection and motivate research into novel architectures which optimally exploit magnitude and phase information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑