WildSVG:迈向真实世界条件下可靠的SVG生成
WildSVG: Towards Reliable SVG Generation Under Real-Word Conditions
AI总结:
WildSVG通过引入现实世界基准测试,揭示了现有多模态模型在真实场景下生成SVG的不足,并指出了改进方向。
摘要:
我们引入了SVG提取任务,其目标是将特定的视觉输入从图像转换为可缩放的向量图形。现有的多模态模型在从干净的渲染或文本描述生成SVG时表现优异,但在现实世界场景中,自然图像引入的噪声、杂乱和领域偏移使得它们效果欠佳。在这个方向上的一个核心挑战是缺乏合适的基准测试。为了解决这一需求,我们引入了WildSVG基准测试,由两个互补的数据集组成:Natural WildSVG,由包含公司logo的真实图像及其SVG注释构建而成,以及Synthetic WildSVG,将复杂的SVG渲染融入真实场景中以模拟困难条件。这些资源为系统化评估SVG提取提供了首个基础。我们对最先进的多模态模型进行了基准测试,并发现当前方法在现实场景中进行可靠SVG提取时表现仍不充分。然而,迭代细化方法指出了一个有前途的发展路径,且模型能力正逐步提升。
英文摘要:
We introduce the task of SVG extraction, which consists in translating specific visual inputs from an image into scalable vector graphics. Existing multimodal models achieve strong results when generating SVGs from clean renderings or textual descriptions, but they fall short in real-world scenarios where natural images introduce noise, clutter, and domain shifts. A central challenge in this direction is the lack of suitable benchmarks. To address this need, we introduce the WildSVG Benchmark, formed by two complementary datasets: Natural WildSVG, built from real images containing company logos paired with their SVG annotations, and Synthetic WildSVG, which blends complex SVG renderings into real scenes to simulate difficult conditions. Together, these resources provide the first foundation for systematic benchmarking SVG extraction. We benchmark state-of-the-art multimodal models and find that current approaches perform well below what is needed for reliable SVG extraction in real scenarios. Nonetheless, iterative refinement methods point to a promising path forward, and model capabilities are steadily improving
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。