arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.07858eess.AScs.LGcs.SD
收藏

基于逆问题求解的音频解码

Audio Decoding by Inverse Problem Solving

Dolby Sweden AB(杜比瑞典公司)

Pedro J. Villasana T., Lars Villemoes, Janusz Klejsa, Per Hedelin

AI总结:

该研究将音频解码视为逆问题,通过扩散后验采样结合显式条件函数求解,在多种比特率和内容类型上优于传统方法,还可减少梯度计算量并提升客观性能。

摘要:

我们将音频解码视为一个逆问题,并通过扩散后验采样来求解该问题。针对变换域感知音频编解码器示例所提供的输入信号测量值,我们开发了显式条件函数。我们通过评估一组比特率与任务无关先验模型的任意组合,证明了该方法的可行性。例如,我们观察到,当用在语音和钢琴上联合训练的模型替换语音模型时,钢琴音频的解码效果显著提升,同时语音性能得以保持。使用更通用的音乐模型时,在广泛的内容类型和比特率范围内,该方法的解码效果均优于传统方法。作为所提出的条件推导基础的噪声均值模型,与基于Tweedie均值的方法相比,能够大幅减少扩散后验采样的梯度评估次数。将Tweedie均值与我们的条件函数相结合可提升客观性能。音频演示可访问https://dpscodec-demo.github.io/查看。

英文摘要:

We consider audio decoding as an inverse problem and solve it through diffusion posterior sampling. Explicit conditioning functions are developed for input signal measurements provided by an example of a transform domain perceptual audio codec. Viability is demonstrated by evaluating arbitrary pairings of a set of bitrates and task-agnostic prior models. For instance, we observe significant improvements on piano while maintaining speech performance when a speech model is replaced by a joint model trained on both speech and piano. With a more general music model, improved decoding compared to legacy methods is obtained for a broad range of content types and bitrates. The noisy mean model, underlying the proposed derivation of conditioning, enables a significant reduction of gradient evaluations for diffusion posterior sampling, compared to methods based on Tweedie's mean. Combining Tweedie's mean with our conditioning functions improves the objective performance. An audio demo is available at https://dpscodec-demo.github.io/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑