arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.04032cs.SDcs.LGeess.AS

多阶段音乐源修复与BandSplit-RoFormer分离及HiFi++ GAN

Multi-Stage Music Source Restoration with BandSplit-RoFormer Separation and HiFi++ GAN

Institute of Computational Perception (CP-JKU) Johannes Kepler University Linz, Austria(计算感知研究所(CP-JKU)约翰· Kepler大学林茨,奥地利)

Tobias Morocutti, Emmanouil Karystinaios, Jonathan Greif, Gerhard Widmer

AI总结:

本文提出多阶段音乐源修复方法,结合BandSplit-RoFormer分离与HiFi++ GAN修复,实现高质量音乐声部恢复。

摘要:

音乐源修复(MSR)旨在从完全混合和母带处理的音频中恢复原始未处理的乐器声部,其中生产效果和分布伪影违反了常见的线性混合假设。本技术报告介绍了CP-JKU团队为2025年MSR ICASSP挑战赛设计的系统。我们的方法将MSR分解为分离和修复两个阶段。首先,一个单通道BandSplit-RoFormer分离器预测八个声部以及一个辅助其他声部,并通过三阶段课程学习进行训练,从4声部预热微调(使用LoRA)逐步扩展到8声部通过头扩展实现。其次,我们应用了一个训练为通用型的HiFi++ GAN波形修复器,然后将其专门化为八个乐器专用专家。

英文摘要:

Music Source Restoration (MSR) targets recovery of original, unprocessed instrument stems from fully mixed and mastered audio, where production effects and distribution artifacts violate common linear-mixture assumptions. This technical report presents the CP-JKU team's system for the MSR ICASSP Challenge 2025. Our approach decomposes MSR into separation and restoration. First, a single BandSplit-RoFormer separator predicts eight stems plus an auxiliary other stem, and is trained with a three-stage curriculum that progresses from 4-stem warm-start fine-tuning (with LoRA) to 8-stem extension via head expansion. Second, we apply a HiFi++ GAN waveform restorer trained as a generalist and then specialized into eight instrument-specific experts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑