arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.14443cs.CV
收藏

通过简化矢量图形控制图像

Controlling Your Image via Simplified Vector Graphics

The University of Texas at Austin, USA(德克萨斯大学奥斯汀分校);Clemson University, USA(克莱姆森大学);SparcAI Inc., USA(SparcAI公司)

Lanqing Guo, Xi Liu, Yufei Wang, Zhihao Li, Siyu Huang

AI总结:

本研究提出通过简化矢量图形实现图像元素层面的可控生成,通过分层结构和语义对齐的矢量图形表示,实现对几何、颜色和物体语义的精确控制,适用于图像编辑和精细内容创作。

摘要:

近年来,图像生成技术在视觉质量上取得了显著进展,但仍然存在一个根本性挑战:图像生成能否在元素层面进行控制,从而实现直观的修改,如调整形状、改变颜色或添加或移除物体?在本工作中,我们通过简化矢量图形(VGs)引入分层可控生成来解决这一挑战。我们的方法首先高效地将图像解析为具有语义对齐和结构一致性的分层矢量图形表示。在此基础上,我们设计了一个由矢量图形引导的新型图像合成框架,允许用户自由修改元素,并无缝地将这些编辑转化为逼真输出。通过利用矢量图形的结构和语义特征,结合噪声预测,我们的方法在几何、颜色和物体语义方面提供了精确控制。大量实验表明,我们的方法在图像编辑、物体层面操控和精细内容创作等多样化应用中均表现出色,建立了可控图像生成的新范式。项目页面:https://guolanqing.github.io/Vec2Pix/

英文摘要:

Recent advances in image generation have achieved remarkable visual quality, while a fundamental challenge remains: Can image generation be controlled at the element level, enabling intuitive modifications such as adjusting shapes, altering colors, or adding and removing objects? In this work, we address this challenge by introducing layer-wise controllable generation through simplified vector graphics (VGs). Our approach first efficiently parses images into hierarchical VG representations that are semantic-aligned and structurally coherent. Building on this representation, we design a novel image synthesis framework guided by VGs, allowing users to freely modify elements and seamlessly translate these edits into photorealistic outputs. By leveraging the structural and semantic features of VGs in conjunction with noise prediction, our method provides precise control over geometry, color, and object semantics. Extensive experiments demonstrate the effectiveness of our approach in diverse applications, including image editing, object-level manipulation, and fine-grained content creation, establishing a new paradigm for controllable image generation. Project page: https://guolanqing.github.io/Vec2Pix/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑