提高测试自动化成熟度：多域文献综述
Improving Test Automation Maturity: a Multivocal Literature Review
摘要：
成熟的测试自动化是快速实现软件质量的关键。在本文中，我们提出了一个多域的文献综述，目的是调查和综合文献中给出的指导方针，以提高测试自动化成熟度。我们选择并回顾了81个原始研究，包括26个学术文献和55个灰色文献来源。从初步研究中，我们提取了26个测试自动化最佳实践（例如，定义有效的测试自动化策略，建立良好的测试环境，开发高质量的测试脚本），并收集了许多建议（例如，以实施/改进方法、技术技巧、概念、基于经验的方法等形式）介绍如何实施这些最佳做法。我们提出了主要意见：（1）只有6个最佳实践对成熟度改进的积极作用已经被学术研究使用正式的经验方法进行了评估;（2）本MLR中的一些技术相关的最佳实践没有在测试成熟度模型中提出;（3）一些最佳实践可以与其他学者提出的成功因素和成熟度障碍联系起来;（4）关于如何实施拟议最佳做法的大多数建议是从经验研究中确定的，其有效性需要使用正式的经验方法，通过跨地点的经验证据进一步评估;（5）在文献中，关于如何进行某些最佳做法的一些建议是相互矛盾的，关于如何进行某些最佳做法的一些建议仍然需要进一步的定性分析。
英文摘要：
Mature test automation is key for achieving software quality at speed. In this paper, we present a multivocal literature review with the objective to survey and synthesize the guidelines given in the literature for improving test automation maturity. We selected and reviewed 81 primary studies, consisting of 26 academic literature and 55 grey literature sources. From primary studies, we extracted 26 test automation best practices (e.g., Define an effective test automation strategy, Set up good test environments, Develop high-quality test scripts) and collected many pieces of advice (e.g., in forms of implementation/improvement approaches, technical techniques, concepts, experience-based heuristics) on how to conduct these best practices. We made main observations: (1) There are only 6 best practices whose positive effect on maturity improvement have been evaluated by academic studies using formal empirical methods; (2) Several technical related best practices in this MLR were not presented in test maturity models; (3) Some best practices can be linked to success factors and maturity impediments proposed by other scholars; (4) Most pieces of advice on how to conduct proposed best practices were identified from experience studies and their effectiveness need to be further evaluated with cross-site empirical evidence using formal empirical methods; (5) In the literature, some advice on how to conduct certain best practices are conflicting, and some advice on how to conduct certain best practices still need further qualitative analysis.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
