好的噪声带来好的编辑:一种基于扩散的视频编辑方法,无需训练,结合图像和文本提示
Good Noise Makes Good Edits: A Training-Free Diffusion-Based Video Editing with Image and Text Prompts
AI总结:
VINO是一种无需训练的视频编辑方法,结合图像和文本提示,通过ρ-启动采样和扩张双掩码实现结构化噪声地图,从而实现高质量视频编辑。
摘要:
我们提出了VINO,一种首个无需训练的零样本视频编辑方法,基于图像和文本进行条件编辑。我们的方法引入ρ-启动采样和扩张双掩码,以构建结构化的噪声地图,从而实现一致且准确的编辑。为进一步提高视觉保真度,我们提出了零图像引导,一种可控的负提示策略。大量实验表明,VINO能够忠实将参考图像融入视频编辑中,其性能优于最先进的基线方法,且无需任何测试时或实例特定的训练。
英文摘要:
We propose VINO, the first zero-shot, training-free video editing method conditioned on both image and text. Our approach introduces $ρ$-start sampling and dilated dual masking to construct structured noise maps that enable coherent and accurate edits. To further enhance visual fidelity, we present zero image guidance, a controllable negative prompt strategy. Extensive experiments demonstrate that VINO faithfully incorporates the reference image into video edits, achieving strong performance compared to state-of-the-art baselines, all without any test-time or instance-specific training.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。