arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.14843cs.CV

CLIPDraw: Exploring Text-to-Drawing Synthesis through Language-Image Encoders

Cross Compass Ltd.(Cross Compass公司);Massachusetts Institute of Technology(麻省理工学院);Tokyo Institute of Technology(东京工业大学);University of Tokyo(东京大学)

Kevin Frans, L. B. Soros, Olaf Witkowski

英文摘要:

This work presents CLIPDraw, an algorithm that synthesizes novel drawings based on natural language input. CLIPDraw does not require any training; rather a pre-trained CLIP language-image encoder is used as a metric for maximizing similarity between the given description and a generated drawing. Crucially, CLIPDraw operates over vector strokes rather than pixel images, a constraint that biases drawings towards simpler human-recognizable shapes. Results compare between CLIPDraw and other synthesis-through-optimization methods, as well as highlight various interesting behaviors of CLIPDraw, such as satisfying ambiguous text in multiple ways, reliably producing drawings in diverse artistic styles, and scaling from simple to complex visual representations as stroke count is increased. Code for experimenting with the method is available at: https://colab.research.google.com/github/kvfrans/clipdraw/blob/main/clipdraw.ipynb

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑