The first Cadenza challenges: using machine learning competitions to improve music for listeners with a hearing loss
University of Salford(索尔福德大学);University of Leeds(利兹大学);University of Nottingham(诺丁汉大学);University of Sheffield(谢菲尔德大学)
Gerardo Roa Dabike, Michael A. Akeroyd, Scott Bannister, Jon P. Barker, Trevor J. Cox, Bruno Fazenda, Jennifer Firth, Simone Graetzer, Alinka Greasley, Rebecca … 展开作者
Gerardo Roa Dabike, Michael A. Akeroyd, Scott Bannister, Jon P. Barker, Trevor J. Cox, Bruno Fazenda, Jennifer Firth, Simone Graetzer, Alinka Greasley, Rebecca R. Vos, William M. Whitmer
It is well established that listening to music is an issue for those with hearing loss, and hearing aids are not a universal solution. How can machine learning be used to address this? This paper details the first application of the open challenge methodology to use machine learning to improve audio quality of music for those with hearing loss. The first challenge was a stand-alone competition (CAD1) and had 9 entrants. The second was an 2024 ICASSP grand challenge (ICASSP24) and attracted 17 entrants. The challenge tasks concerned demixing and remixing pop/rock music to allow a personalised rebalancing of the instruments in the mix, along with amplification to correct for raised hearing thresholds. The software baselines provided for entrants to build upon used two state-of-the-art demix algorithms: Hybrid Demucs and Open-Unmix. Evaluation of systems was done using the objective metric HAAQI, the Hearing-Aid Audio Quality Index. No entrants improved on the best baseline in CAD1 because there was insufficient room for improvement. Consequently, for ICASSP24 the scenario was made more difficult by using loudspeaker reproduction and specified gains to be applied before remixing. This also made the scenario more useful for listening through hearing aids. 9 entrants scored better than the the best ICASSP24 baseline. Most entrants used a refined version of Hybrid Demucs and NAL-R amplification. The highest scoring system combined the outputs of several demixing algorithms in an ensemble approach. These challenges are now open benchmarks for future research with the software and data being freely available.
Evaluating the Intelligibility Benefits of Neural Speech Enrichment for Listeners with Normal Hearing and Hearing Impairment using the Greek Harvard Corpus
University of Crete(克里特大学);Chania General Hospital(干尼亚综合医院)
Head shadow enhancement with low-frequency beamforming improves sound localization and speech perception for simulated bimodal listeners
KU Leuven – University of Leuven(鲁汶大学)
由于双耳线索的可用性差,许多听力受损的听众难以定位声音。带有人工耳蜗和对侧助听器的听众--所谓的双峰听众--是表现最差的,因为两耳间的时间和水平差都很难传递。提出了一种新的低频头部阴影增强方法。头部阴影增强是通过在每只耳朵中使用对侧衰减的固定波束形成器来实现的。该方法导致耳间水平差随角度单调变化。在语音和噪声空间分离的情况下,它还提高了低频信噪比。我们验证了该方法在两个实验中的声学模拟双峰听。在定位实验中,与标准全向麦克风相比,性能从50.5°提高到26.8°均方根误差。在噪声中的语音实验中,语音从正面方向呈现。当噪声来自人工耳蜗侧时,语音接收阈值提高了15.7 dB SNR,当噪声来自助听器侧时,语音接收阈值提高了7.6 dB SNR,当噪声来自各个方向时,语音接收阈值不受影响。除了双模态听众,该方法也可能是有前途的双侧人工耳蜗或助听器用户。其低计算复杂度使得该方法适合于在当前临床设备中的应用。保留字:头影增强、耳间水平差增强、声音定位、定向听力、噪声中言语、言语清晰度PACS:43.60.Fg、43.66.Pn、43.66.Qp、43.66.Rq、43.66.Ts、43.71.- k,43.71.Es,43.71.Ky
Overview Of The 2023 Icassp Sp Clarity Challenge: Speech Enhancement For Hearing Aids
Acoustics Research Centre, University of Salford(索尔福德大学声学研究中心);Department of Computer Science, University of Sheffield(谢菲尔德大学计算机科学系);School of Medicine, University of Nottingham(诺丁汉大学医学院);School of Psychology, Cardiff University(卡迪夫大学心理学院)
Predicting EEG Responses to Attended Speech via Deep Neural Networks for Speech
Eriksholm Research Centre(埃里克肖尔姆研究中心);Linköping University(林雪平大学);University of Stuttgart(斯图加特大学);Technical University of Denmark(丹麦技术大学);Oticon A/S(奥迪康公司)
Disentangling peripheral hearing loss from central and cognitive effects on speech intelligibility in older adults
Center for Innovative and Joint Research, Wakayama University(和歌山大学创新与联合研究中心);Graduate School of Systems Engineering, Wakayama University(和歌山大学系统工学研究科);School of Informatics and Engineering, the University of Electro-Communications(电气通信大学信息与工程学院)
A Study of Joint Effect on Denoising Techniques and Visual Cues to Improve Speech Intelligibility in Cochlear Implant Simulation
Research Center for Information Technology Innovation, Academia Sinica(中央研究院资讯科技创新研究中心);National Taiwan University(台湾大学);Institute of Linguistics, Academia Sinica(中央研究院语言学研究所)