arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2606.26342eess.AS
收藏

大规模数据库和预测模型:商用助听器中听众评分的语音理解容易度

A Large-Scale Database and Predictive Model of Listener-Rated Ease of Speech Understanding in Commercial Hearing Aids

HearAdvisor

Andrew Sabin, Steve Taddei, Abram Bailey

AI总结:

构建大规模感知数据集(104,298条评分),使用冻结Whisper编码器提取差异嵌入并训练MLP头,预测听众对商用助听器语音理解容易度的评分,在场景级别显著优于HASPIv2。

摘要:

HearAdvisor旨在为助听器消费者提供反映真实聆听体验的音频性能指标和录音。对于语音相关指标,HearAdvisor历来使用HASPIv2,这是一种旨在预测客观可懂度并在模拟失真下验证的指标。其与消费者对商用助听器理解容易度评分的关系尚不确定。本文介绍了一个大规模感知数据集和用于听众评分的语音理解感知收益的学习指标。自报听力损失的网站访客完成了一项盲法、MUSHRA启发的听力测试,其中他们对商用助听器的录音在五点“理解容易度”量表上进行评分。该数据集包含151,608条评分,经质量筛选后为104,298条,涵盖来自83个商用产品的10,394个双耳声学假人录音,跨越72个真实声学场景。为预测这些评分,我们将助听音频和匹配的干净语音参考通过冻结的Whisper编码器,减去其内部表示,并在得到的差异嵌入上训练一个小型MLP头。在训练中未见的设备上,学习指标在场景级别显著优于HASPIv2(总体r=0.92 vs. 0.83;嘈杂=0.89 vs. 0.75;安静=0.79 vs. 0.58)。在嘈杂场景中,性能达到听众评分的分半信度;在安静场景中,接近该上限。该模型还对受控增益和SNR操作做出合理响应。数据集和模型共同提供了一种预测真实商用助听器录音中听众评分的语音理解容易度的新方法。

英文摘要:

HearAdvisor aims to provide hearing-aid consumers with audio-performance metrics and recordings that reflect real listening experience. For speech-related metrics, HearAdvisor has historically used HASPIv2, a metric designed to predict objective intelligibility and validated primarily under simulated distortions. Its relationship to consumer-rated ease of understanding for commercial hearing aids is uncertain. Here we introduce a large-scale perceptual dataset and learned metric for listener-rated perceived benefit for speech understanding. Website visitors with self-reported hearing loss completed a blind, MUSHRA-inspired listening test in which they rated recordings of commercial hearing aids on a five-point "Ease of Understanding" scale. The dataset contains 151,608 ratings, 104,298 after quality screening, spanning 10,394 binaural acoustic-manikin recordings from 83 commercial products across 72 realistic acoustic scenes. To predict these ratings, we pass aided audio and a matched clean-speech reference through a frozen Whisper encoder, subtract their internal representations, and train a small MLP head on the resulting difference embedding. On devices held out of training, the learned metric substantially outperforms HASPIv2 at the scene level (overall r = 0.92 vs. 0.83; loud = 0.89 vs. 0.75; quiet = 0.79 vs. 0.58). In loud scenes, performance reaches the split-half reliability of the listener ratings; in quiet scenes, it approaches that ceiling. The model also responds sensibly to controlled gain and SNR manipulations. Together, the dataset and model provide a new way to predict listener-rated ease of speech understanding for real commercial hearing-aid recordings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑