arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.00707cs.CV

PhysEdit: 一种通过自适应时空推理实现物理一致的区域感知图像编辑

PhysEdit: Physically-Consistent Region-Aware Image Editing via Adaptive Spatio-Temporal Reasoning

iFLYTEK;Aegon THTF

Guandong Li, Mengxia Ye

AI总结:

PhysEdit通过自适应时空推理实现物理一致的区域感知图像编辑,提升编辑效率和准确性,适用于不同复杂度的图像编辑任务。

摘要:

图像编辑指令具有异质性:颜色交换、对象插入和物理动作编辑需要不同的空间覆盖和推理深度,但现有基于推理的编辑器对每条指令应用单一固定推理配方。我们主张在空间和时间轴上都具有适应性是缺失的自由度,我们提出了PhysEdit,一种围绕这一原则构建的编辑框架。PhysEdit引入了两个推理时间模块,这些模块无需重新训练骨干网络即可组合。其核心是(1)复杂度自适应推理深度(CARD)直接从指令和参考图像预测编辑复杂度,并分配推理步骤数N_r和推理令牌长度r每样本--将之前固定的推理计划转换为条件计算问题。CARD由(2)空间推理掩码(SRM)支持,该掩码从交叉注意力中提取指令条件空间先验,将推理限制在语义上需要的区域。在完整的737个ImgEdit Basic-Edit套件上,PhysEdit在强推理基线上实现了1.18倍的墙钟加速(64.3秒 vs. 76.1秒每样本),同时略微提高了指令遵循度(CLIP-T 0.2283 vs. 0.2266,+0.7%)并在噪声中匹配了身份保持(CLIP-I 0.8246 vs. 0.8280)。加速是类别依赖的,达到外观级编辑时达到1.52倍,验证了CARD的自适应分配作为效率增益的主要来源。30个样本的试点与完整消融实验隔离了每个模块的贡献。

英文摘要:

Image editing instructions are heterogeneous: a color swap, an object insertion, and a physical-action edit all demand different spatial coverage and different reasoning depth, yet existing reasoning-based editors apply a single fixed inference recipe to every instruction. We argue that adaptivity along both the spatial and temporal axes is the missing degree of freedom, and we present PhysEdit, an editing framework built around this principle. PhysEdit introduces two inference-time modules that compose without retraining the backbone. At its core, (1) Complexity-Adaptive Reasoning Depth (CARD) predicts edit complexity directly from the instruction and reference image and allocates the reasoning step count N_r and reasoning-token length r per sample -- turning a previously fixed inference schedule into a conditional-computation problem. CARD is supported by (2) a Spatial Reasoning Mask (SRM) that extracts an instruction-conditioned spatial prior from cross-attention to confine reasoning to regions that semantically require it. On the full 737-case ImgEdit Basic-Edit Suite, PhysEdit delivers a 1.18x wall-clock speedup (64.3s vs. 76.1s per sample) over a strong reasoning baseline while slightly improving instruction adherence (CLIP-T 0.2283 vs. 0.2266, +0.7%) and matching identity preservation within noise (CLIP-I 0.8246 vs. 0.8280). The speedup is category-dependent and reaches 1.52x on appearance-level edits, validating CARD's adaptive allocation as the principal source of efficiency gain. A 30-sample pilot with full ablations isolates the contribution of each module.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑