Organizations, particularly medium and large enterprises, typically rely heavily on complex, distributed systems to deliver critical services and products. However, the growing complexity of these systems poses challenges in ensuring service availability, performance, and reliability. Traditional resilience testing methods often fail to capture the intricate interactions and failure modes of modern systems. Chaos Engineering addresses these challenges by proactively testing how systems in production behave under turbulent conditions, allowing developers to uncover and resolve potential issues before they escalate into outages. Though chaos engineering has received growing attention from researchers and practitioners alike, we observed a lack of reviews that synthesize insights from both academic and grey literature. Hence, we conducted a Multivocal Literature Review (MLR) on chaos engineering to address this research gap by systematically analyzing 96 academic and grey literature sources published between January 2016 and April 2024. We first used the chosen sources to derive a unified definition of chaos engineering and to identify key functionalities, components, and adoption drivers. We also developed a taxonomy for chaos engineering platforms and compared the relevant tools using it. Finally, we analyzed the current state of chaos engineering research and identified several open research issues.
Requirements engineering in global scaled agile software development environment: a multi-vocal literature review protocol
背景:需求工程在全球规模的敏捷软件开发和规划阶段的多声文献综述。目的:制定一个协议,以指定将遵循的计划,以进行全球规模敏捷软件开发中需求工程的多声音文献综述研究。方法:遵循Kitchenham and Charters(2007)和Garousi et al.(2019)指南,制定多声文献综述方案。结果:一个经过验证的方案,进行多声音文献综述。结论:综述方案包括以下五个阶段:研究问题、搜索策略、验证综述过程、报告综述和对方案进行变更。