arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.10284cs.CVcs.AIcs.CL

MotionEdit: 动作导向图像编辑的基准测试与学习

MotionEdit: Benchmarking and Learning Motion-Centric Image Editing

Tencent AI(腾讯AI);University of California, Los Angeles(加州大学洛杉矶分校)

Yixin Wan, Lei Ke, Wenhao Yu, Kai-Wei Chang, Dong Yu

AI总结:

MotionEdit提出一个动作导向图像编辑数据集及评估基准,通过MotionNFT框架提升编辑质量和运动保真度。

摘要:

我们介绍了MotionEdit,一个全新的数据集,用于动作导向的图像编辑任务——即在保持身份、结构和物理合理性的同时修改主体的动作和互动。与现有专注于静态外观变化或仅包含稀疏、低质量运动编辑的图像编辑数据集不同,MotionEdit提供了高质量的图像对,描绘了从连续视频中提取和验证的逼真运动转换。这项新任务不仅具有科学挑战性,而且具有实际意义,推动下游应用,如基于帧的视频合成和动画。为了评估模型在新任务上的性能,我们引入了MotionEdit-Bench,一个挑战模型在动作导向编辑上的基准,并通过生成、判别和基于偏好的指标来衡量模型性能。基准测试结果表明,现有最先进的扩散编辑模型在动作编辑上仍然极具挑战性。为了解决这一差距,我们提出了MotionNFT(动作导向的负向意识微调),一种后训练框架,通过计算输入和模型编辑图像之间运动流与地面真实运动匹配程度的运动对齐奖励,引导模型向准确的运动转换发展。在FLUX.1 Kontext和Qwen-Image-Edit上的大量实验表明,MotionNFT在不牺牲通用编辑能力的情况下,一致提高了基础模型在动作编辑任务中的编辑质量和运动保真度,展示了其有效性。我们的代码在https://github.com/elainew728/motion-edit/。

英文摘要:

We introduce MotionEdit, a novel dataset for motion-centric image editing-the task of modifying subject actions and interactions while preserving identity, structure, and physical plausibility. Unlike existing image editing datasets that focus on static appearance changes or contain only sparse, low-quality motion edits, MotionEdit provides high-fidelity image pairs depicting realistic motion transformations extracted and verified from continuous videos. This new task is not only scientifically challenging but also practically significant, powering downstream applications such as frame-controlled video synthesis and animation. To evaluate model performance on the novel task, we introduce MotionEdit-Bench, a benchmark that challenges models on motion-centric edits and measures model performance with generative, discriminative, and preference-based metrics. Benchmark results reveal that motion editing remains highly challenging for existing state-of-the-art diffusion-based editing models. To address this gap, we propose MotionNFT (Motion-guided Negative-aware Fine Tuning), a post-training framework that computes motion alignment rewards based on how well the motion flow between input and model-edited images matches the ground-truth motion, guiding models toward accurate motion transformations. Extensive experiments on FLUX.1 Kontext and Qwen-Image-Edit show that MotionNFT consistently improves editing quality and motion fidelity of both base models on the motion editing task without sacrificing general editing ability, demonstrating its effectiveness. Our code is at https://github.com/elainew728/motion-edit/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑