HearAdvisor旨在为助听器消费者提供反映真实聆听体验的音频性能指标和录音。对于语音相关指标,HearAdvisor历来使用HASPIv2,这是一种旨在预测客观可懂度并在模拟失真下验证的指标。其与消费者对商用助听器理解容易度评分的关系尚不确定。本文介绍了一个大规模感知数据集和用于听众评分的语音理解感知收益的学习指标。自报听力损失的网站访客完成了一项盲法、MUSHRA启发的听力测试,其中他们对商用助听器的录音在五点“理解容易度”量表上进行评分。该数据集包含151,608条评分,经质量筛选后为104,298条,涵盖来自83个商用产品的10,394个双耳声学假人录音,跨越72个真实声学场景。为预测这些评分,我们将助听音频和匹配的干净语音参考通过冻结的Whisper编码器,减去其内部表示,并在得到的差异嵌入上训练一个小型MLP头。在训练中未见的设备上,学习指标在场景级别显著优于HASPIv2(总体r=0.92 vs. 0.83;嘈杂=0.89 vs. 0.75;安静=0.79 vs. 0.58)。在嘈杂场景中,性能达到听众评分的分半信度;在安静场景中,接近该上限。该模型还对受控增益和SNR操作做出合理响应。数据集和模型共同提供了一种预测真实商用助听器录音中听众评分的语音理解容易度的新方法。
英文摘要:
HearAdvisor aims to provide hearing-aid consumers with audio-performance metrics and recordings that reflect real listening experience. For speech-related metrics, HearAdvisor has historically used HASPIv2, a metric designed to predict objective intelligibility and validated primarily under simulated distortions. Its relationship to consumer-rated ease of understanding for commercial hearing aids is uncertain. Here we introduce a large-scale perceptual dataset and learned metric for listener-rated perceived benefit for speech understanding. Website visitors with self-reported hearing loss completed a blind, MUSHRA-inspired listening test in which they rated recordings of commercial hearing aids on a five-point "Ease of Understanding" scale. The dataset contains 151,608 ratings, 104,298 after quality screening, spanning 10,394 binaural acoustic-manikin recordings from 83 commercial products across 72 realistic acoustic scenes. To predict these ratings, we pass aided audio and a matched clean-speech reference through a frozen Whisper encoder, subtract their internal representations, and train a small MLP head on the resulting difference embedding. On devices held out of training, the learned metric substantially outperforms HASPIv2 at the scene level (overall r = 0.92 vs. 0.83; loud = 0.89 vs. 0.75; quiet = 0.79 vs. 0.58). In loud scenes, performance reaches the split-half reliability of the listener ratings; in quiet scenes, it approaches that ceiling. The model also responds sensibly to controlled gain and SNR manipulations. Together, the dataset and model provide a new way to predict listener-rated ease of speech understanding for real commercial hearing-aid recordings.
Evaluating the Intelligibility Benefits of Neural Speech Enrichment for Listeners with Normal Hearing and Hearing Impairment using the Greek Harvard Corpus
University of Crete(克里特大学);Chania General Hospital(干尼亚综合医院)
Audiovisual joint learning for end-to-end hearing aids
Graduate Institute of Communication Engineering, National Taiwan University(国立台湾大学通讯工程学研究所);Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心);Department of Otolaryngology-Head and Neck Surgery, Taipei Veterans General Hospital(台北荣民总医院耳鼻喉头颈外科);School of Medicine, National Yang Ming Chiao Tung University(国立阳明交通大学医学院);Center for Hearing Research, University of California, Irvine(加州大学欧文分校听力研究中心)
Head shadow enhancement with low-frequency beamforming improves sound localization and speech perception for simulated bimodal listeners
KU Leuven – University of Leuven(鲁汶大学)
由于双耳线索的可用性差,许多听力受损的听众难以定位声音。带有人工耳蜗和对侧助听器的听众--所谓的双峰听众--是表现最差的,因为两耳间的时间和水平差都很难传递。提出了一种新的低频头部阴影增强方法。头部阴影增强是通过在每只耳朵中使用对侧衰减的固定波束形成器来实现的。该方法导致耳间水平差随角度单调变化。在语音和噪声空间分离的情况下,它还提高了低频信噪比。我们验证了该方法在两个实验中的声学模拟双峰听。在定位实验中,与标准全向麦克风相比,性能从50.5°提高到26.8°均方根误差。在噪声中的语音实验中,语音从正面方向呈现。当噪声来自人工耳蜗侧时,语音接收阈值提高了15.7 dB SNR,当噪声来自助听器侧时,语音接收阈值提高了7.6 dB SNR,当噪声来自各个方向时,语音接收阈值不受影响。除了双模态听众,该方法也可能是有前途的双侧人工耳蜗或助听器用户。其低计算复杂度使得该方法适合于在当前临床设备中的应用。保留字:头影增强、耳间水平差增强、声音定位、定向听力、噪声中言语、言语清晰度PACS:43.60.Fg、43.66.Pn、43.66.Qp、43.66.Rq、43.66.Ts、43.71.- k,43.71.Es,43.71.Ky
Overview Of The 2023 Icassp Sp Clarity Challenge: Speech Enhancement For Hearing Aids
Acoustics Research Centre, University of Salford(索尔福德大学声学研究中心);Department of Computer Science, University of Sheffield(谢菲尔德大学计算机科学系);School of Medicine, University of Nottingham(诺丁汉大学医学院);School of Psychology, Cardiff University(卡迪夫大学心理学院)
HASA-net: A non-intrusive hearing-aid speech assessment network
Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心);Nagoya University(名古屋大学);Institute of Information Science, Academia Sinica(中央研究院资讯科学研究所);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Predicting EEG Responses to Attended Speech via Deep Neural Networks for Speech
Eriksholm Research Centre(埃里克肖尔姆研究中心);Linköping University(林雪平大学);University of Stuttgart(斯图加特大学);Technical University of Denmark(丹麦技术大学);Oticon A/S(奥迪康公司)
Disentangling peripheral hearing loss from central and cognitive effects on speech intelligibility in older adults
Center for Innovative and Joint Research, Wakayama University(和歌山大学创新与联合研究中心);Graduate School of Systems Engineering, Wakayama University(和歌山大学系统工学研究科);School of Informatics and Engineering, the University of Electro-Communications(电气通信大学信息与工程学院)
Automated speech audiometry: Can it work using open-source pre-trained Kaldi-NL automatic speech recognition?
University Medical Center Groningen, University of Groningen(格罗宁根大学医学中心,格罗宁根大学);W.J. Kolff Institute for Biomedical Engineering and Materials Science, University Medical Center Groningen, University of Groningen(W.J.科尔夫生物医学工程与材料科学研究所,格罗宁根大学医学中心,格罗宁根大学);University of Twente(特文特大学)
A Study of Joint Effect on Denoising Techniques and Visual Cues to Improve Speech Intelligibility in Cochlear Implant Simulation
Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心);National Taiwan University(台湾大学);Institute of Linguistics, Academia Sinica(中央研究院语言学研究所)
From Spikes to Speech: NeuroVoc -- A Biologically Plausible Vocoder Framework for Auditory Perception and Cochlear Implant Simulation
Leiden Institute of Advanced Computer Science(莱顿高级计算机科学研究所);Department of Otorhinolaryngology(耳鼻喉科部门);Leiden Institute for Brain and Cognition(莱顿脑认知研究所);Bioelectronics group, EEMCS(生物电子组,EEMCS)