arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2506.12520cs.CV

好的噪声带来好的编辑:一种基于扩散的视频编辑方法,无需训练,结合图像和文本提示

Good Noise Makes Good Edits: A Training-Free Diffusion-Based Video Editing with Image and Text Prompts

KAIST(韩国科学技术院)

Saemee Choi, Sohyun Jeong, Hyojin Jang, Jaegul Choo, Jinhee Kim

AI总结:

VINO是一种无需训练的视频编辑方法,结合图像和文本提示,通过ρ-启动采样和扩张双掩码实现结构化噪声地图,从而实现高质量视频编辑。

摘要:

我们提出了VINO,一种首个无需训练的零样本视频编辑方法,基于图像和文本进行条件编辑。我们的方法引入ρ-启动采样和扩张双掩码,以构建结构化的噪声地图,从而实现一致且准确的编辑。为进一步提高视觉保真度,我们提出了零图像引导,一种可控的负提示策略。大量实验表明,VINO能够忠实将参考图像融入视频编辑中,其性能优于最先进的基线方法,且无需任何测试时或实例特定的训练。

英文摘要:

We propose VINO, the first zero-shot, training-free video editing method conditioned on both image and text. Our approach introduces $ρ$-start sampling and dilated dual masking to construct structured noise maps that enable coherent and accurate edits. To further enhance visual fidelity, we present zero image guidance, a controllable negative prompt strategy. Extensive experiments demonstrate that VINO faithfully incorporates the reference image into video edits, achieving strong performance compared to state-of-the-art baselines, all without any test-time or instance-specific training.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑