arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.01818cs.CVcs.AIcs.GR
收藏

语义排版中的词即图像

Word-As-Image for Semantic Typography

Tel-Aviv University(特拉维夫大学);Goldsmiths University(金史密斯大学);Reichman University(赖克曼大学)

Shir Iluz, Yael Vinker, Amir Hertz, Daniel Berio, Daniel Cohen-Or, Ariel Shamir

摘要:

文字图像是一种语义排版技术,其中文字插图呈现了单词含义的可视化,同时还保留了其可读性。提出了一种自动生成文字图像插图的方法。这项任务是非常具有挑战性的,因为它需要对单词的语义理解,以及在哪里以及如何以视觉上令人愉悦和清晰的方式描述这些语义的创造性想法。我们依赖于最近大型预训练语言视觉模型的卓越能力,以视觉方式提取文本概念。我们的目标是简单,简洁,黑白设计,传达语义清楚。我们故意不改变字母的颜色或纹理,也不使用装饰。我们的方法优化了每个字母的轮廓,以传达所需的概念,由预训练的稳定扩散模型指导。我们纳入了额外的损失条款,以确保文本的易读性和字体风格的保留。我们在众多示例中展示了高质量和引人入胜的结果,并与替代技术进行了比较。

英文摘要:

A word-as-image is a semantic typography technique where a word illustration presents a visualization of the meaning of the word, while also preserving its readability. We present a method to create word-as-image illustrations automatically. This task is highly challenging as it requires semantic understanding of the word and a creative idea of where and how to depict these semantics in a visually pleasing and legible manner. We rely on the remarkable ability of recent large pretrained language-vision models to distill textual concepts visually. We target simple, concise, black-and-white designs that convey the semantics clearly. We deliberately do not change the color or texture of the letters and do not use embellishments. Our method optimizes the outline of each letter to convey the desired concept, guided by a pretrained Stable Diffusion model. We incorporate additional loss terms to ensure the legibility of the text and the preservation of the style of the font. We show high quality and engaging results on numerous examples and compare to alternative techniques.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑