arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.12893cs.SEcs.PF
收藏

基于智能强化学习驱动的测试代理的性能测试

Performance Testing Using a Smart Reinforcement Learning-Driven Test Agent

Mahshid Helali Moghadam, Golrokh Hamidi, Markus Borg, Mehrdad Saadatmand, Markus Bohlin, Björn Lisper, Pasqualina Potena

摘要:

性能测试的目的是产生一个高效和有效的工作量,以确定性能问题是具有挑战性的。许多自动化方法主要依赖于分析系统模型、源代码或提取系统在执行过程中的使用模式。然而,这样的信息和工件并不总是可用的。此外,生成的工作负载中的所有事务不会以相同的方式影响系统的性能,经过微调的工作负载可以以有效的方式完成测试目标。无模型强化学习无模型强化学习被广泛用于在不依赖于系统模型的情况下找到最优行为以实现许多决策问题中的目标。本文提出,如果生成测试工作量,以满足测试目标的最佳策略(方式)可以通过一个测试代理学习,那么有效的测试自动化将是可能的,而不依赖于系统模型或源代码。我们提出了一个自适应强化学习驱动的负载测试代理,RELOAD,学习最佳的测试工作量生成策略,并生成有效的工作量,以满足测试目标。一旦代理学习到最优策略,它就可以在后续的测试活动中重用学习到的策略。实验结果表明,该智能负载测试代理能够以较低的测试成本完成测试任务,提高测试效率。

英文摘要:

Performance testing with the aim of generating an efficient and effective workload to identify performance issues is challenging. Many of the automated approaches mainly rely on analyzing system models, source code, or extracting the usage pattern of the system during the execution. However, such information and artifacts are not always available. Moreover, all the transactions within a generated workload do not impact the performance of the system the same way, a finely tuned workload could accomplish the test objective in an efficient way. Model-free reinforcement learning is widely used for finding the optimal behavior to accomplish an objective in many decision-making problems without relying on a model of the system. This paper proposes that if the optimal policy (way) for generating test workload to meet a test objective can be learned by a test agent, then efficient test automation would be possible without relying on system models or source code. We present a self-adaptive reinforcement learning-driven load testing agent, RELOAD, that learns the optimal policy for test workload generation and generates an effective workload efficiently to meet the test objective. Once the agent learns the optimal policy, it can reuse the learned policy in subsequent testing activities. Our experiments show that the proposed intelligent load test agent can accomplish the test objective with lower test cost compared to common load testing procedures, and results in higher test efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑