arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.05959eess.AS
收藏

利用扩散模型估计与恢复未知非线性失真

Estimation and Restoration of Unknown Nonlinear Distortion using Diffusion

Michal Švento, Eloi Moliner, Lauri Juvela, Alec Wright, Vesa Välimäki

AI总结:

针对非线性特性与原始信号均未知的音频失真难题,提出基于无条件训练扩散模型的盲恢复方法,可同时估计非线性函数与恢复信号,性能优于现有方法,可应用于音频修复等多个领域。

摘要:

本文研究了非线性失真音频信号的恢复问题,以及对所施加的无记忆非线性操作的识别。论文聚焦于非线性特性与原始输入信号均未知的困难但具有实际重要性的场景。所提出的方法使用在吉他或语音信号上进行无条件训练的生成式扩散模型,在推理阶段联合建模并反转非线性系统,同时输出无记忆非线性函数模型与恢复后的音频信号。本文展示了包括硬削波、软削波、数字量化、半波整流以及波折叠非线性在内的成功反转案例研究。结果表明,在本文测试的非线性函数中,三次Catmull-Rom样条最适合近似这些非线性特性。在吉他录音场景下,与有信息先验的监督方法对比显示,所提出的盲方法在客观指标上至少与这些方法表现相当。在失真语音上的实验表明,该盲方法优于通用语音增强技术,能够恢复原始语音质量。该方法可应用于音频效果建模、音乐与语音录音修复以及模拟录音介质特性表征。

英文摘要:

The restoration of nonlinearly distorted audio signals, alongside the identification of the applied memoryless nonlinear operation, is studied. The paper focuses on the difficult but practically important case in which both the nonlinearity and the original input signal are unknown. The proposed method uses a generative diffusion model trained unconditionally on guitar or speech signals to jointly model and invert the nonlinear system at inference time. Both the memoryless nonlinear function model and the restored audio signal are obtained as output. Successful example case studies are presented including inversion of hard and soft clipping, digital quantization, half-wave rectification, and wavefolding nonlinearities. Our results suggest that, out of the nonlinear functions tested here, the cubic Catmull-Rom spline is best suited to approximating these nonlinearities. In the case of guitar recordings, comparisons with informed and supervised methods show that the proposed blind method is at least as good as they are in terms of objective metrics. Experiments on distorted speech show that the proposed blind method outperforms general-purpose speech enhancement techniques and restores the original voice quality. The proposed method can be applied to audio effects modeling, restoration of music and speech recordings, and characterization of analog recording media.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑