arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2405.17364eess.AS
收藏

广播与流媒体中的语音响度

Speech Loudness in Broadcasting and Streaming

Matteo Torcoli, Mhd Modar Halimeh, Thomas Leitz, Yannik Grewe, Michael Kratschmer, Bernhard Neugebauer, Adrian Murtaza, Harald Fuchs, Emanuël A. P. Habets

AI总结:

针对广播和流媒体中语音响度不足的问题,提出利用DNN隔离语音信号以精确估计语音响度,并基于SLD和SBLD定义关键段落,以支持内容制作中的评估与控制。

摘要:

广播和流媒体中响度的引入和规范给观众带来了明显的好处,例如节目和频道之间的一致性水平。然而,语音响度经常被报告在某些段落中过低,这可能会妨碍对电影和电视节目的充分理解和享受。本文提出扩展业界通常使用的基于响度的测量集。我们专注于语音响度,并表明,当无法获得干净语音时,深度神经网络(DNNs)可用于隔离语音信号,从而准确估计语音响度,与语音门控响度相比,提供更精确的估计。此外,我们定义了关键段落,即语音可能难以理解的段落。关键段落基于局部语音响度偏差(SLD)和局部语音与背景响度差(SBLD)来定义,因为SLD和SBLD对可懂度和听努力有显著贡献。与更全面的可懂度和听努力测量相比,SLD和SBLD可以直接测量,直观,最重要的是,可以通过调整混音中的语音电平或在用户端启用个性化来轻松控制。最后,提供了示例,展示关键段落的检测如何在内容制作期间和之后支持语音信号的评估和控制。

英文摘要:

The introduction and regulation of loudness in broadcasting and streaming brought clear benefits to the audience, e.g., a level of uniformity across programs and channels. Yet, speech loudness is frequently reported as being too low in certain passages, which can hinder the full understanding and enjoyment of movies and TV programs. This paper proposes expanding the set of loudness-based measures typically used in the industry. We focus on speech loudness, and we show that, when clean speech is not available, Deep Neural Networks (DNNs) can be used to isolate the speech signal and so to accurately estimate speech loudness, providing a more precise estimate compared to speech-gated loudness. Moreover, we define critical passages, i.e., passages in which speech is likely to be hard to understand. Critical passages are defined based on the local Speech Loudness Deviation (SLD) and the local Speech-to-Background Loudness Difference (SBLD), as SLD and SBLD significantly contribute to intelligibility and listening effort. In contrast to other more comprehensive measures of intelligibility and listening effort, SLD and SBLD can be straightforwardly measured, are intuitive, and, most importantly, can be easily controlled by adjusting the speech level in the mix or by enabling personalization at the user's end. Finally, examples are provided that show how the detection of critical passages can support the evaluation and control of the speech signal during and after content production.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑