arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2601.01593cs.CVcs.MM

超越补丁:面向多模态少样本字体生成的全局感知自回归模型

Beyond Patches: Global-aware Autoregressive Model for Multimodal Few-Shot Font Generation

Wangxuan Institute of Computer Technology, Peking University(北京大学王学轩计算机技术研究所);School of Electronics Engineering and Computer Science, Peking University(北京大学电子工程与计算机科学学院)

Haonan Cai, Yuxuan Luo, Zhouhui Lian

AI总结:

本文提出GAR-Font,一种多模态少样本字体生成的自回归框架,通过全局感知分词器、多模态风格编码器和后处理流程,提升了字体生成的全局风格一致性和质量。

摘要:

手动字体设计是一个将风格化视觉概念转化为一致的字形集的复杂过程。在自动少样本字体生成(FFG)中,模型常常难以在有限参考下保持结构完整性和风格忠实性。尽管自回归(AR)模型展示了出色的生成能力,但其在FFG中的应用受限于传统的补丁级标记化,这忽略了对字体合成至关重要的全局依赖关系。此外,现有FFG方法仍局限于图像到图像的范式,仅依赖视觉参考,忽略了语言在传达字体设计风格意图中的作用。为了解决这些限制,我们提出了GAR-Font,一种新的AR框架用于多模态少样本字体生成。GAR-Font引入了一个全局感知的分词器,能够有效捕捉局部结构和全局风格模式,一个多模态风格编码器通过轻量级的语言-风格适配器提供灵活的风格控制,无需进行高强度的多模态预训练,并且一个后处理流程进一步增强了结构完整性和风格一致性。大量实验表明,GAR-Font在现有FFG方法上表现更优,尤其在保持全局风格忠实性和在文本风格指导下获得更高质量的结果方面表现出色。

英文摘要:

Manual font design is an intricate process that transforms a stylistic visual concept into a coherent glyph set. This challenge persists in automated Few-shot Font Generation (FFG), where models often struggle to preserve both the structural integrity and stylistic fidelity from limited references. While autoregressive (AR) models have demonstrated impressive generative capabilities, their application to FFG is constrained by conventional patch-level tokenization, which neglects global dependencies crucial for coherent font synthesis. Moreover, existing FFG methods remain within the image-to-image paradigm, relying solely on visual references and overlooking the role of language in conveying stylistic intent during font design. To address these limitations, we propose GAR-Font, a novel AR framework for multimodal few-shot font generation. GAR-Font introduces a global-aware tokenizer that effectively captures both local structures and global stylistic patterns, a multimodal style encoder offering flexible style control through a lightweight language-style adapter without requiring intensive multimodal pretraining, and a post-refinement pipeline that further enhances structural fidelity and style coherence. Extensive experiments show that GAR-Font outperforms existing FFG methods, excelling in maintaining global style faithfulness and achieving higher-quality results with textual stylistic guidance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑