arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1802.04732cs.SE
收藏

自动报告移动应用程序的GUI设计违规

Automated Reporting of GUI Design Violations for Mobile Apps

Kevin Moran, Boyang Li, Carlos Bernal-Cárdenas, Dan Jelf, Denys Poshyvanyk

摘要:

移动应用程序的初始化通常采用图形用户界面(GUI)的模型形式,表示为描绘满足需求的GUI小部件的正确布局和样式的静态图像。在这个初始模型之后,设计工件被交给开发人员,他们的目标是在代码中准确地实现这些GUI和所需的功能。由于模型和代码之间存在相当大的抽象差距,开发人员经常会引入与GUI相关的错误,这些错误可能会对应用程序在竞争激烈的市场中的成功产生负面影响。此外,在快速变化的应用程序的进化背景下,这种错误很常见。这导致了设计团队验证应用程序的每个屏幕都是根据预期的设计规范实现的费时费力的任务。本文介绍了一种新颖的自动化方法,用于验证移动应用程序的GUI是否按照其预期设计实现。我们的方法解决了GUI相关的信息,从实现的应用程序和模型,并使用计算机视觉技术,以确定在移动GUI的实现中的常见错误。我们在一个名为GVT的工具中为Android实现了这种方法,并对开源应用程序进行了受控的经验评估,并与华为的设计师和开发人员进行了工业评估。结果表明,GVT解决了一个重要的,困难的,高度实用的问题,具有显着的效率和准确性,是有用的和可扩展的工业设计师和开发人员的角度来看。目前,华为有超过一千名工业设计师和开发人员使用该工具来提高移动应用程序的质量。

英文摘要:

The inception of a mobile app often takes form of a mock-up of the Graphical User Interface (GUI), represented as a static image delineating the proper layout and style of GUI widgets that satisfy requirements. Following this initial mock-up, the design artifacts are then handed off to developers whose goal is to accurately implement these GUIs and the desired functionality in code. Given the sizable abstraction gap between mock-ups and code, developers often introduce mistakes related to the GUI that can negatively impact an app's success in highly competitive marketplaces. Moreover, such mistakes are common in the evolutionary context of rapidly changing apps. This leads to the time-consuming and laborious task of design teams verifying that each screen of an app was implemented according to intended design specifications. This paper introduces a novel, automated approach for verifying whether the GUI of a mobile app was implemented according to its intended design. Our approach resolves GUI-related information from both implemented apps and mock-ups and uses computer vision techniques to identify common errors in the implementations of mobile GUIs. We implemented this approach for Android in a tool called GVT and carried out both a controlled empirical evaluation with open-source apps as well as an industrial evaluation with designers and developers from Huawei. The results show that GVT solves an important, difficult, and highly practical problem with remarkable efficiency and accuracy and is both useful and scalable from the point of view of industrial designers and developers. The tool is currently used by over one-thousand industrial designers and developers at Huawei to improve the quality of their mobile apps.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑