一致且可编辑：文本引导视频编辑的平衡框架
Consistent and Editable: A Balanced Framework for Text-Guided Video Editing
AI总结：
针对视频编辑中时间一致性和可编辑性难以平衡的问题，提出EquiEdit框架。通过时间Mamba模块增强时间一致性，设计基于频谱变换的噪声注入策略提升可编辑性，实验证明该方法有效。
摘要：
最近，扩散模型在文本引导视频编辑领域取得了显著成功。然而，现有工作在视频编辑中往往难以平衡时间一致性和可编辑性之间的权衡，因为一致性和可编辑性通常呈负相关。为了解决这个问题，我们提出了一个名为EquiEdit的高质量视频编辑框架，该框架在提高编辑视频的时间一致性和可编辑性的同时，在两者之间实现了平衡。在时间一致性方面，所提出的具有定制时间感知扫描的时间Mamba模块按照四个设计方向扫描融合后的视频序列，有效地增强了编辑视频的帧间一致性。对于可编辑性，我们设计了一种基于频谱变换的噪声注入策略来增加编辑灵活性，其中使用傅里叶变换来保留用于编辑的初始潜在噪声中的隐藏结构，确保编辑视频的帧间一致性和对输入视频的保真度。广泛的定性和定量实验证明了我们的方法在时间一致性和可编辑性方面的有效性，以及它对输入视频本身的高保真度。
英文摘要：
Recently, diffusion models have achieved considerable success in the text-guided video editing domain. However, existing works often struggle to balance the trade-off between temporal consistency and editability in video editing, with consistency and editability typically being inversely related. To address this, we propose a high-quality video editing framework enhanced for consistency and editability, named EquiEdit, which improves coordinatively the temporal consistency and editability of the edited videos while achieving a balance between the two. In terms of temporal consistency, the proposed temporal Mamba module with a tailored temporal-aware scanning scans fused video sequences following four designed directions, effectively enhancing the inter-frame consistency of edited videos. For editability, we design a noise injection strategy based on the spectral transformation to increase editing flexibility, where the Fourier transform is used to preserve the hidden structure in the initial latent noise used for editing, ensuring inter-frame consistency of the edited video and fidelity to the input video. Extensive qualitative and quantitative experiments demonstrate the effectiveness of our method in terms of temporal consistency and editability, as well as its great fidelity to the input video itself.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
