arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.07547cs.SDeess.AS
收藏

通用音频基础模型用于全面身体声音听诊

A Generalist Audio Foundation Model for Comprehensive Body Sound Auscultation

Shanghai Jiao Tong University(上海交通大学);Xinhua Hospital Affiliated To Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属新华医院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Tongji University(同济大学)

Pingjie Wang, Liudan Zhao, Zihan Zhao, Miao He, Xin Sun, Ya Zhang, Kun Sun, Yanfeng Wang, Yu Wang

AI总结:

本文提出AuscultaBase,一个基于自监督与对比学习的通用音频基础模型,用于全面身体声音听诊,在AuscultaBench基准上优于现有方法,助力临床筛查与早期干预。

摘要:

准确高效的基于听诊的诊断对于早期疾病检测至关重要,尤其是在专业临床专业知识稀缺的资源有限环境中。传统听诊严重依赖临床医生的经验,存在显著的观察者间差异,而现有AI模型由于非代表性训练数据的局限性,往往表现不佳。在本研究中,我们引入了AuscultaBase,一种新颖的AI驱动诊断框架,利用自监督和对比学习技术以及大规模多源数据集成来推进身体声音分析。通过生成稳健的特征表示,AuscultaBase显著提升了异常检测、疾病分类和活动识别任务的性能。在我们新建立的基准AuscultaBench上的全面评估表明,AuscultaBase在关键性能指标上持续优于最先进的方法,突显了其作为临床筛查和早期疾病干预的可扩展且成本效益高的工具的潜力。代码和模型检查点已在https://github.com/applewpj/AuscultaBase发布。

英文摘要:

Accurate and efficient auscultation-based diagnostics are vital for early disease detection, especially in resource-limited settings where specialized clinical expertise is scarce. Traditional auscultation, which heavily depends on clinician experience, suffers from significant inter-observer variability, while existing AI models often falter due to the limitations of non-representative training data. In this study, we introduce AuscultaBase, a novel AI-driven diagnostic framework that harnesses self-supervised and contrastive learning techniques alongside large-scale, multi-source data integration to advance body sound analysis. By generating robust feature representations, AuscultaBase markedly enhances performance in abnormality detection, disease classification, and activity recognition tasks. Comprehensive evaluations on our newly established benchmark, AuscultaBench, demonstrate that AuscultaBase consistently outperforms state-of-the-art methods across key performance metrics, underscoring its potential as a scalable and cost-effective tool for clinical screening and early disease intervention. The code and model checkpoint has been released in https://github.com/applewpj/AuscultaBase.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑