arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.09188cs.SD
收藏

LatentFlowSR: 通过噪声鲁棒的潜在流匹配实现高质量音频超分辨率

LatentFlowSR: High-Fidelity Audio Super-Resolution via Noise-Robust Latent Flow Matching

University of Science and Technology of China(中国科学技术大学)

Fei Liu, Yang Ai, Hui-Peng Du, Yu-Fei Shi, Zhen-Hua Ling

AI总结:

本文提出LatentFlowSR方法,利用条件流匹配在潜在空间中实现音频超分辨率,通过噪声鲁棒的自动编码器和ODE求解器生成高分辨率音频,实验表明其在多种音频类型和设置中均优于基线方法。

摘要:

音频超分辨率旨在从带宽受限的低分辨率音频中恢复缺失的高频细节,从而提高重建信号的自然度和感知质量。然而,大多数现有方法直接在波形或时频域操作,不仅涉及高维生成空间,而且主要局限于语音任务,对更复杂的音频类型如音效和音乐仍有较大提升空间。为缓解这些限制,我们引入LatentFlowSR,一种新的音频超分辨率方法,利用条件流匹配(CFM)在潜在表示空间中。具体而言,我们首先训练一个噪声鲁棒的自动编码器,将低分辨率音频编码到连续的潜在空间中。在低分辨率潜在表示条件下,CFM机制逐步从高斯先验中生成对应的高分辨率潜在表示,使用一步普通微分方程(ODE)求解器。生成的高分辨率潜在表示随后通过预训练的自动编码器解码以重建高分辨率音频。实验结果表明,LatentFlowSR在各种音频类型和超分辨率设置中均优于基线方法。这些结果表明,所提出的方法具有强大的高频重建能力和稳健的泛化性能,为音频超分辨率中潜在空间建模的有效性提供了有力证据。所有相关代码将在论文评审过程完成后公开发布。

英文摘要:

Audio super-resolution aims to recover missing high-frequency details from bandwidth-limited low-resolution audio, thereby improving the naturalness and perceptual quality of the reconstructed signal. However, most existing methods directly operate in the waveform or time-frequency domain, which not only involves high-dimensional generation spaces but is also largely limited to speech tasks, leaving substantial room for improvement on more complex audio types such as sound effects and music. To mitigate these limitations, we introduce LatentFlowSR, a new audio super-resolution approach that leverages conditional flow matching (CFM) within a latent representation space. Specifically, we first train a noise-robust autoencoder, which encodes low-resolution audio into a continuous latent space. Conditioned on the low-resolution latent representation, a CFM mechanism progressively generates the corresponding high-resolution latent representation from a Gaussian prior with a one-step ordinary differential equation (ODE) solver. The resulting high-resolution latent representation is then decoded by the pretrained autoencoder to reconstruct the high-resolution audio. Experimental results demonstrate that LatentFlowSR achieves competitive or superior performance compared with baseline methods across various audio types and super-resolution settings. These results indicate that the proposed method possesses strong high-frequency reconstruction capability and robust generalization performance, providing compelling evidence for the effectiveness of latent-space modeling in audio super-resolution. All relevant code will be made publicly available upon completion of the paper review process.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑