arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.00355cs.LGcs.SDeess.AS
收藏

StethoLM:用于跨临床任务的心肺分析的音频语言模型

StethoLM: Audio Language Model for Cardiopulmonary Analysis Across Clinical Tasks

Eindhoven University of Technology(埃因霍温理工大学)

Yishan Wang, Tsai-Ning Wang, Mathias Funk, Aaqib Saeed

AI总结:

StethoLM是首个用于心肺听诊的音频语言模型,能执行多种临床任务,通过多阶段训练提升性能和鲁棒性,为临床听诊提供新的AI解决方案。

摘要:

听诊心肺声音——听诊——是临床检查中第一步也是最基础的步骤。尽管它快速且非侵入性,但解读细微音频线索需要多年经验。最近的深度学习方法在自动化心肺声音分析方面取得进展,但大多数方法仅限于简单的分类,提供很少的临床可解释性或决策支持。我们提出了StethoLM,这是首个专门用于心肺听诊的音频语言模型,能够执行跨整个听诊分析范围的指令驱动临床任务。StethoLM集成了音频编码与医学语言模型主干,并在StethoBench上进行训练,该基准包含77,027个指令-响应对,这些对是从16,125个标记的心肺录音中合成的,涵盖七个临床任务类别:二分类、检测、报告、推理、鉴别诊断、比较和基于位置的分析。通过结合监督微调和直接偏好优化的多阶段训练,StethoLM在分布外数据上实现了显著的性能和鲁棒性提升。我们的工作为临床听诊的指令遵循AI系统奠定了基础。

英文摘要:

Listening to heart and lung sounds - auscultation - is one of the first and most fundamental steps in a clinical examination. Despite being fast and non-invasive, it demands years of experience to interpret subtle audio cues. Recent deep learning methods have made progress in automating cardiopulmonary sound analysis, yet most are restricted to simple classification and offer little clinical interpretability or decision support. We present StethoLM, the first audio-language model specialized for cardiopulmonary auscultation, capable of performing instruction-driven clinical tasks across the full spectrum of auscultation analysis. StethoLM integrates audio encoding with a medical language model backbone and is trained on StethoBench, a comprehensive benchmark comprising 77,027 instruction-response pairs synthesized from 16,125 labeled cardiopulmonary recordings spanning seven clinical task categories: binary classification, detection, reporting, reasoning, differential diagnosis, comparison, and location-based analysis. Through multi-stage training that combines supervised fine-tuning and direct preference optimization, StethoLM achieves substantial gains in performance and robustness on out-of-distribution data. Our work establishes a foundation for instruction-following AI systems in clinical auscultation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑