arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.10100cs.SDcs.AIcs.LGeess.AS
收藏

调频收听:有限数据临床环境中音频分类器性能分析

Tuning In: Analysis of Audio Classifier Performance in Clinical Settings with Limited Data

University of Toronto(多伦多大学);Sunnybrook Research Institute(桑尼布鲁克研究所);Western University(西安大略大学)

Hamza Mahdi, Eptehal Nashnoush, Rami Saab, Arjun Balachandar, Rishit Dagli, Lucas X. Perri, Houman Khosravani

AI总结:

针对临床小数据音频分类,本文比较CNN、transformer及预训练音频模型,并通过中风患者数据集验证预训练、模型选择与频谱图预处理对性能的影响。

摘要:

本研究评估了在临床环境中受小数据集约束(反映真实世界前瞻性数据收集)的音频分类深度学习模型。我们分析了包括DenseNet和ConvNeXt在内的CNN,以及ViT、SWIN和AST等transformer模型,并将它们与YAMNet和VGGish等预训练音频模型进行比较。我们的方法强调了在特定临床数据上微调之前,先在大型数据集上进行预训练的优势。我们前瞻性地收集了两个首批此类的中风患者音频数据集。我们研究了多种预处理技术,发现RGB和灰度频谱图变换会根据模型从预训练中学到的先验知识,以不同方式影响模型性能。研究结果表明,在小数据集情境下,CNN可以匹敌甚至超越transformer模型,其中DenseNet-Contrastive和AST模型表现出显著性能。本研究强调了在声音分类中通过模型选择、预训练和预处理获得增量边际收益的重要性;这为依赖音频分类的临床诊断提供了宝贵见解。

英文摘要:

This study assesses deep learning models for audio classification in a clinical setting with the constraint of small datasets reflecting real-world prospective data collection. We analyze CNNs, including DenseNet and ConvNeXt, alongside transformer models like ViT, SWIN, and AST, and compare them against pre-trained audio models such as YAMNet and VGGish. Our method highlights the benefits of pre-training on large datasets before fine-tuning on specific clinical data. We prospectively collected two first-of-their-kind patient audio datasets from stroke patients. We investigated various preprocessing techniques, finding that RGB and grayscale spectrogram transformations affect model performance differently based on the priors they learn from pre-training. Our findings indicate CNNs can match or exceed transformer models in small dataset contexts, with DenseNet-Contrastive and AST models showing notable performance. This study highlights the significance of incremental marginal gains through model selection, pre-training, and preprocessing in sound classification; this offers valuable insights for clinical diagnostics that rely on audio classification.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑