RFM-Editing:基于矩形流匹配的文本引导音频编辑
RFM-Editing: Rectified Flow Matching for Text-guided Audio Editing
AI总结:
本文提出基于矩形流匹配的音频编辑框架,通过构建包含重叠多事件音频的数据集,实现文本引导下的精确音频编辑,无需辅助提示或掩码,保持高质量编辑效果。
摘要:
扩散模型在文本到音频生成中表现出显著进展。然而,文本引导的音频编辑仍处于早期阶段。该任务旨在修改音频信号中的目标内容,同时保持其余部分不变,因此需要精确的定位和根据文本提示进行忠实编辑。现有基于训练和零样本的方法依赖于完整的描述或昂贵的优化,常难以处理复杂编辑或缺乏实用性。在本文中,我们提出了一种新颖的端到端高效矩形流匹配基于扩散框架的音频编辑方法,并构建了一个包含重叠多事件音频的数据集,以支持在复杂场景中的训练和基准测试。实验表明,我们的模型在无需辅助提示或掩码的情况下实现了语义一致的对齐,同时在各种指标上保持了竞争性的编辑质量。
英文摘要:
Diffusion models have shown remarkable progress in text-to-audio generation. However, text-guided audio editing remains in its early stages. This task focuses on modifying the target content within an audio signal while preserving the rest, thus demanding precise localization and faithful editing according to the text prompt. Existing training-based and zero-shot methods that rely on full-caption or costly optimization often struggle with complex editing or lack practicality. In this work, we propose a novel end-to-end efficient rectified flow matching-based diffusion framework for audio editing, and construct a dataset featuring overlapping multi-event audio to support training and benchmarking in complex scenarios. Experiments show that our model achieves faithful semantic alignment without requiring auxiliary captions or masks, while maintaining competitive editing quality across metrics.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。