arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2110.07775cs.HCcs.AIcs.LG
收藏

使用深度学习模型从高级文本描述创建用户界面模型

Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Models

University of California, Berkeley(加利福尼亚大学伯克利分校);Google Research(谷歌研究院)

Forrest Huang, Gang Li, Xin Zhou, John F. Canny, Yang Li

摘要:

用户界面(UI)的设计过程通常从阐明高层设计目标开始。然而,将这些高级设计目标转换为具体的设计模型需要大量的工作和UI设计专业知识。为了方便应用设计人员和开发人员进行此过程,我们介绍了三种深度学习技术,用于从描述高级设计目标的自然语言短语(例如“弹出显示图像和其他选项”)创建低保真度UI模型。特别是,我们贡献了两个基于检索的方法和一个生成方法,以及预处理和后处理技术,以确保创建的UI模型的质量。我们定量和定性地比较和对比每种方法的能力,建议连贯的,多样的和相关的UI设计模型。我们进一步评估这些方法与15个专业的UI设计师和从业者,以了解每种方法的优点和缺点。设计师们积极响应这些方法的潜力,以协助设计过程。

英文摘要:

The design process of user interfaces (UIs) often begins with articulating high-level design goals. Translating these high-level design goals into concrete design mock-ups, however, requires extensive effort and UI design expertise. To facilitate this process for app designers and developers, we introduce three deep-learning techniques to create low-fidelity UI mock-ups from a natural language phrase that describes the high-level design goal (e.g. "pop up displaying an image and other options"). In particular, we contribute two retrieval-based methods and one generative method, as well as pre-processing and post-processing techniques to ensure the quality of the created UI mock-ups. We quantitatively and qualitatively compare and contrast each method's ability in suggesting coherent, diverse and relevant UI design mock-ups. We further evaluate these methods with 15 professional UI designers and practitioners to understand each method's advantages and disadvantages. The designers responded positively to the potential of these methods for assisting the design process.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑