SliderEdit++:基于指令的图像编辑中改进的滑块轨迹
SliderEdit++: Improved Slider Trajectories in Instruction-Based Image Editing
AI总结:
针对现有滑块图像编辑的可控性缺陷,提出SliderEdit++方法,结合多空间轨迹正则化与解耦目标,在SlideBench基准上实现性能提升且速度大幅加快。
摘要:
基于滑块的控制旨在为用户提供对指令式图像编辑中各个编辑强度的连续、细粒度控制。然而,现有方法无法实现可靠的连续可控性:拖动滑块会产生突兀的视觉跳跃和非单调变化,而联合控制的滑块之间会相互干扰。为系统研究这些局限性,我们引入SlideBench——一个用于连续图像编辑的综合基准,涵盖多样的编辑类别,并配备一套统一的指标,用于量化单调进展、感知连续性和滑块间解耦性。基于这些观察,我们提出SliderEdit++,该方法明确对中间编辑轨迹进行正则化,而非仅监督其端点。我们的方法结合了速度空间和语义空间的轨迹正则化与频谱控制,以实现平滑、可预测的滑块拖动,同时采用解耦目标以减少独立控制编辑之间的干扰。在SlideBench上,SliderEdit++达到了最先进的性能,相较于最强基线,其总体得分提升了18.5%。与此同时,使用少步编辑骨干网络使我们的方法比现有基于滑块的方法快约3倍至20倍,实现了响应速度显著提升的交互式编辑。
英文摘要:
Slider-based control aims to give users continuous, fine-grained control over the intensity of individual edits in instruction-based image editing. However, existing approaches fail to deliver reliable continuous controllability: traversing a slider can produce abrupt visual jumps and non-monotonic changes, while jointly controlled sliders can interfere with one another. To systematically study these limitations, we introduce SlideBench, a comprehensive benchmark for continuous image editing spanning diverse editing categories and equipped with a unified suite of metrics quantifying monotonic progression, perceptual continuity, and inter-slider disentanglement. Building on these observations, we propose SliderEdit++, which explicitly regularizes the intermediate editing trajectory rather than supervising only its endpoints. Our method combines velocity- and semantic-space trajectory regularization with spectral control to encourage smooth, predictable slider traversal, together with a disentanglement objective that reduces interference between independently controlled edits. On SlideBench, SliderEdit++ achieves state-of-the-art performance, improving the overall score by 18.5% relative to the strongest baseline. At the same time, using a few-step editing backbone makes our method approximately 3x to 20x faster than existing slider-based approaches, enabling substantially more responsive interactive editing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。