VET:识别和避免UI勘探柏油路
VET: Identifying and Avoiding UI Exploration Tarpits
摘要:
尽管经过十多年的研究,移动UI测试工具仍然具有挑战性,以达到令人满意的有效性,特别是在具有丰富功能和大型代码库的工业应用程序上。我们的经验表明,现有的移动UI测试工具很容易陷入探索困境,这些工具在很长一段时间内只能使用一小部分应用程序功能。例如,工具在早期阶段注销应用程序而无法重新登录,并且从那时起,该工具就陷入了探索应用程序的预登录功能(即,而不是它的主要功能。虽然工具供应商/用户可以手动硬编码工具的规则,以避免特定的探索tarpit,但这些规则很难推广,在面对转移的测试环境和快速的应用程序迭代时很脆弱。为了识别和解决探索tarpits,我们提出了VET,一种通用方法,包括在给定的特定被测应用(AUT)上为给定的特定Android UI测试工具提供支持系统。VET在AUT上运行该工具一段时间并记录UI跟踪,VET基于该UI跟踪通过识别UI跟踪中的模式来识别探索柏油路。然后,VET确定动作(例如,点击注销)或引导或展示探索停机坪的屏幕。在随后的测试运行中,VET引导测试工具防止或从探索柏油路中恢复。根据我们对流行工业应用程序的最先进Android UI测试工具的评估,VET确定了花费高达98.6%测试时间预算的探索柏油路。这些探索tarpit不仅揭示了UI探索策略的局限性,还揭示了工具实现中的缺陷。VET自动解决已识别的探索tarpit,使每个评估的工具,以实现更高的代码覆盖率和提高崩溃触发能力。
英文摘要:
Despite over a decade of research, it is still challenging for mobile UI testing tools to achieve satisfactory effectiveness, especially on industrial apps with rich features and large code bases. Our experiences suggest that existing mobile UI testing tools are prone to exploration tarpits, where the tools get stuck with a small fraction of app functionalities for an extensive amount of time. For example, a tool logs out an app at early stages without being able to log back in, and since then the tool gets stuck with exploring the app's pre-login functionalities (i.e., exploration tarpits) instead of its main functionalities. While tool vendors/users can manually hardcode rules for the tools to avoid specific exploration tarpits, these rules can hardly generalize, being fragile in face of diverted testing environments and fast app iterations. To identify and resolve exploration tarpits, we propose VET, a general approach including a supporting system for the given specific Android UI testing tool on the given specific app under test (AUT). VET runs the tool on the AUT for some time and records UI traces, based on which VET identifies exploration tarpits by recognizing their patterns in the UI traces. VET then pinpoints the actions (e.g., clicking logout) or the screens that lead to or exhibit exploration tarpits. In subsequent test runs, VET guides the testing tool to prevent or recover from exploration tarpits. From our evaluation with state-of-the-art Android UI testing tools on popular industrial apps, VET identifies exploration tarpits that cost up to 98.6% testing time budget. These exploration tarpits reveal not only limitations in UI exploration strategies but also defects in tool implementations. VET automatically addresses the identified exploration tarpits, enabling each evaluated tool to achieve higher code coverage and improve crash-triggering capabilities.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。