arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.02540cs.AIcs.DCcs.SE
收藏

迈向跨云和边缘的API测试

Towards API Testing Across Cloud and Edge

IBM Research(IBM研究院);IBM Services(IBM服务部);IBM Systems(IBM系统部)

Samuel Ackerman, Sanjib Choudhury, Nirmit Desai, Eitan Farchi, Dan Gisolfi, Andrew Hicks, Saritha Route, Diptikalyan Saha

摘要:

API经济正在推动混合云和边缘环境中业务应用的数字化转型。为了使这种转换成功,需要对应用程序API组合进行端到端测试。即使在集中式云环境中,API组合的测试也具有挑战性,因为它需要覆盖功能和可靠性要求。场景的组合空间是巨大的,例如,API输入参数、API执行顺序和网络故障。混合云和边缘环境加剧了API测试的挑战,因为需要在动态广域网(可能跨越网络边界)之间协调测试执行。为了应对这一挑战,我们设想了一个测试框架,名为分布式软件测试工具包(DSTK)。DSTK利用组合测试设计(CTD)来满足功能需求,然后通过测试执行反馈和基于人工智能的搜索算法之间的幕后闭环自动满足可靠性需求。在闭环的每一次迭代中,搜索算法生成更多的可靠性测试场景以供下一步执行。具体而言,设想了五种可靠性测试:API的乱序执行、网络延迟和故障、API性能和吞吐量、API调用图模式的变化以及应用拓扑的变化。

英文摘要:

API economy is driving the digital transformation of business applications across the hybrid Cloud and edge environments. For such transformations to succeed, end-to-end testing of the application API composition is required. Testing of API compositions, even in centralized Cloud environments, is challenging as it requires coverage of functional as well as reliability requirements. The combinatorial space of scenarios is huge, e.g., API input parameters, order of API execution, and network faults. Hybrid Cloud and edge environments exacerbate the challenge of API testing due to the need to coordinate test execution across dynamic wide-area networks, possibly across network boundaries. To handle this challenge, we envision a test framework named Distributed Software Test Kit (DSTK). The DSTK leverages Combinatorial Test Design (CTD) to cover the functional requirements and then automatically covers the reliability requirements via under-the-hood closed loop between test execution feedback and AI based search algorithms. In each iteration of the closed loop, the search algorithms generate more reliability test scenarios to be executed next. Specifically, five kinds of reliability tests are envisioned: out-of-order execution of APIs, network delays and faults, API performance and throughput, changes in API call graph patterns, and changes in application topology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑