arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.05095cs.SDcs.LGeess.AS
收藏

首届 Cadenza 挑战赛:利用机器学习竞赛为听障听众改善音乐

The first Cadenza challenges: using machine learning competitions to improve music for listeners with a hearing loss

University of Salford(索尔福德大学);University of Leeds(利兹大学);University of Nottingham(诺丁汉大学);University of Sheffield(谢菲尔德大学)
Gerardo Roa Dabike, Michael A. Akeroyd, Scott Bannister, Jon P. Barker, Trevor J. Cox, Bruno Fazenda, Jennifer Firth, Simone Graetzer, Alinka Greasley, Rebecca … 展开作者

Gerardo Roa Dabike, Michael A. Akeroyd, Scott Bannister, Jon P. Barker, Trevor J. Cox, Bruno Fazenda, Jennifer Firth, Simone Graetzer, Alinka Greasley, Rebecca R. Vos, William M. Whitmer

AI总结:

本文介绍首届 Cadenza 音乐机器学习挑战赛,通过流行/摇滚音乐分离、重混音与个性化放大任务,建立面向听障听众的开放评测基准。

摘要:

众所周知,听音乐对听障人士而言是一个难题,而助听器并非万能的解决方案。如何利用机器学习来解决这一问题?本文详细介绍了开放挑战赛方法的首次应用,旨在利用机器学习为听障人士改善音乐的音频质量。第一届挑战赛是一项独立竞赛(CAD1),共有 9 名参赛者。第二届是 2024 年 ICASSP 重大挑战赛(ICASSP24),吸引了 17 名参赛者。挑战赛任务涉及对流行/摇滚音乐进行分离和重新混音,以实现混音中各乐器的个性化重新平衡,并通过放大来校正升高的听阈。提供给参赛者在此基础上开发的软件基线使用了两种最先进的分离算法:Hybrid Demucs 和 Open-Unmix。系统评估采用客观指标 HAAQI,即助听器音频质量指数(Hearing-Aid Audio Quality Index)。在 CAD1 中,没有参赛者能够改进最佳基线,因为改进空间不足。因此,在 ICASSP24 中,通过使用扬声器重放并规定在重新混音前施加的增益,使场景变得更困难。这也使该场景更适合通过助听器聆听。9 名参赛者的得分高于 ICASSP24 的最佳基线。大多数参赛者使用了 Hybrid Demucs 的改进版本和 NAL-R 放大。得分最高的系统采用集成方法组合了多种分离算法的输出。这些挑战赛现已成为未来研究的开放基准,相关软件和数据均可免费获取。

英文摘要:

It is well established that listening to music is an issue for those with hearing loss, and hearing aids are not a universal solution. How can machine learning be used to address this? This paper details the first application of the open challenge methodology to use machine learning to improve audio quality of music for those with hearing loss. The first challenge was a stand-alone competition (CAD1) and had 9 entrants. The second was an 2024 ICASSP grand challenge (ICASSP24) and attracted 17 entrants. The challenge tasks concerned demixing and remixing pop/rock music to allow a personalised rebalancing of the instruments in the mix, along with amplification to correct for raised hearing thresholds. The software baselines provided for entrants to build upon used two state-of-the-art demix algorithms: Hybrid Demucs and Open-Unmix. Evaluation of systems was done using the objective metric HAAQI, the Hearing-Aid Audio Quality Index. No entrants improved on the best baseline in CAD1 because there was insufficient room for improvement. Consequently, for ICASSP24 the scenario was made more difficult by using loudspeaker reproduction and specified gains to be applied before remixing. This also made the scenario more useful for listening through hearing aids. 9 entrants scored better than the the best ICASSP24 baseline. Most entrants used a refined version of Hybrid Demucs and NAL-R amplification. The highest scoring system combined the outputs of several demixing algorithms in an ensemble approach. These challenges are now open benchmarks for future research with the software and data being freely available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑