使用超网络识别肌萎缩侧索硬化症患者的构音障碍
Recognition of Dysarthria in Amyotrophic Lateral Sclerosis patients using Hypernetworks
AI总结:
提出首个结合超网络识别ALS患者构音障碍的方法,利用超网络为目标网络生成权重,在VOC-ALS数据集上准确率达82.66%,在泛化、参数效率和鲁棒性上优于现有方法。
摘要:
肌萎缩侧索硬化症(ALS)是一种进行性神经退行性疾病,症状多样,包括言语清晰度下降。现有研究通过预测临床标准 ALSFRS-R 来识别 ALS 患者的构音障碍,依赖特征提取策略以及定制卷积神经网络加全连接层的设计。然而,近期研究表明,采用输入条件计算逻辑的神经网络具有诸多优势,包括更快的训练速度、更好的性能和灵活性。为解决这些问题,我们提出了结合超网络识别构音障碍的首项研究。具体而言,我们使用音频文件,将其转换为 log-Mel 频谱图、delta 和 delta-delta,并将生成的图像通过预训练的修改版 AlexNet 模型。最后,我们使用一个超网络,为目标网络生成权重。实验在最新收集的公开数据集 VOC-ALS 上进行。结果显示,所提方法准确率高达 82.66%,优于包括多模态融合方法在内的强基线,而消融研究的发现证明了所引入方法的有效性。总体而言,我们结合超网络的方法在泛化能力、参数效率和鲁棒性方面优于现有最优结果。
英文摘要:
Amyotrophic Lateral Sclerosis (ALS) constitutes a progressive neurodegenerative disease with varying symptoms, including decline in speech intelligibility. Existing studies, which recognize dysarthria in ALS patients by predicting the clinical standard ALSFRS-R, rely on feature extraction strategies and the design of customized convolutional neural networks followed by dense layers. However, recent studies have shown that neural networks adopting the logic of input-conditional computations enjoy a series of benefits, including faster training, better performance, and flexibility. To resolve these issues, we present the first study incorporating hypernetworks for recognizing dysarthria. Specifically, we use audio files, convert them into log-Mel spectrogram, delta, and delta-delta, and pass the resulting image through a pretrained modified AlexNet model. Finally, we use a hypernetwork, which generates weights for a target network. Experiments are conducted on a newly collected publicly available dataset, namely VOC-ALS. Results showed that the proposed approach reaches Accuracy up to 82.66% outperforming strong baselines, including multimodal fusion methods, while findings from an ablation study demonstrated the effectiveness of the introduced methodology. Overall, our approach incorporating hypernetworks obtains valuable advantages over state-of-the-art results in terms of generalization ability, parameter efficiency, and robustness.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。