DeepWriting:通过深度生成建模使数字墨水可编辑
DeepWriting: Making Digital Ink Editable via Deep Generative Modeling
摘要:
数字墨水有望将手写的灵活性和美学与处理、搜索和编辑数字文本的能力结合起来。字符识别将手写文本转换为数字表示,尽管由于分离内容和风格的交织成分的技术困难而损失了个性化的外观。在本文中,我们提出了一种新的生成神经网络架构,能够从内容中分离出风格,从而使数字墨水可编辑。我们的模型可以合成任意文本,同时让用户控制视觉外观(风格)。例如,允许在不更改内容的情况下进行样式转换,在单词级别编辑数字墨水以及其他应用场景,如拼写检查和手写文本的更正。此外,我们还贡献了一个新的手写文本数据集,在字符级别上进行了细粒度注释,并报告了初始用户评估的结果。
英文摘要:
Digital ink promises to combine the flexibility and aesthetics of handwriting and the ability to process, search and edit digital text. Character recognition converts handwritten text into a digital representation, albeit at the cost of losing personalized appearance due to the technical difficulties of separating the interwoven components of content and style. In this paper, we propose a novel generative neural network architecture that is capable of disentangling style from content and thus making digital ink editable. Our model can synthesize arbitrary text, while giving users control over the visual appearance (style). For example, allowing for style transfer without changing the content, editing of digital ink at the word level and other application scenarios such as spell-checking and correction of handwritten text. We furthermore contribute a new dataset of handwritten text with fine-grained annotations at the character level and report results from an initial user evaluation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。