RCAEval:基于遥测数据的微服务系统根因分析基准
RCAEval: A Benchmark for Root Cause Analysis of Microservice Systems with Telemetry Data
AI总结:
RCAEval是一个开源微服务根因分析基准,提供涵盖735个故障案例的三个数据集和包含十五个可复现基线的评估框架,支持粗粒度与细粒度RCA评估,旨在推动微服务系统根因分析研究。
摘要:
微服务系统的根因分析(RCA)近年来受到广泛关注。然而,目前仍缺乏包含大规模数据集并支持全面评估环境的标准基准。本文介绍了RCAEval,一个开源基准,为微服务系统中的RCA提供数据集和评估环境。首先,我们引入了三个综合数据集,包含从三个微服务系统收集的735个故障案例,涵盖现实世界故障中观察到的各种故障类型。其次,我们提出了一个全面的评估框架,包括十五个可复现的基线,涵盖广泛的RCA方法,并能够评估粗粒度和细粒度的RCA。我们希望这个即用型基准能够使研究人员和从业者进行广泛分析,并为微服务系统RCA的稳健新解决方案铺平道路。
英文摘要:
Root cause analysis (RCA) for microservice systems has gained significant attention in recent years. However, there is still no standard benchmark that includes large-scale datasets and supports comprehensive evaluation environments. In this paper, we introduce RCAEval, an open-source benchmark that provides datasets and an evaluation environment for RCA in microservice systems. First, we introduce three comprehensive datasets comprising 735 failure cases collected from three microservice systems, covering various fault types observed in real-world failures. Second, we present a comprehensive evaluation framework that includes fifteen reproducible baselines covering a wide range of RCA approaches, with the ability to evaluate both coarse-grained and fine-grained RCA. We hope that this ready-to-use benchmark will enable researchers and practitioners to conduct extensive analysis and pave the way for robust new solutions for RCA of microservice systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。