arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.01782cs.SE
收藏

MicroHECL:大规模微服务系统中的高效根因定位

MicroHECL: High-Efficient Root Cause Localization in Large-Scale Microservice Systems

Dewei Liu, Chuan He, Xin Peng, Fan Lin, Chenxi Zhang, Shengfang Gong, Ziang Li, Jiayu Ou, Zheshun Wu

AI总结:

针对微服务系统可用性问题,提出MicroHECL方法,基于动态服务调用图分析异常传播链并排序根因,结合机器学习与统计检测异常,采用剪枝提升效率,在阿里巴巴实现68%的top-3命中率,定位时间从30分钟降至5分钟。

摘要:

工业微服务系统的可用性问题(例如成功下单量和已处理交易量的下降)直接影响业务的运行。这些问题通常由各种类型的服务异常引起,这些异常沿服务依赖关系传播。因此,准确且高效的根因定位对于大规模工业微服务系统而言是一个关键挑战。现有方法使用基于服务依赖图的分析技术来自动定位根因。然而,这些方法由于对服务异常的检测不准确以及对服务依赖图的遍历效率低下而受到限制。在本文中,我们提出了一种针对微服务系统可用性问题的高效根因定位方法,称为MicroHECL。基于动态构建的服务调用图,MicroHECL分析可能的异常传播链,并基于相关性分析对候选根因进行排序。我们结合机器学习和统计方法,为不同类型的服务异常(即性能、可靠性、流量)设计定制化模型进行检测。为了提高效率,我们采用剪枝策略来消除异常传播链分析中无关的服务调用。实验研究表明,MicroHECL在准确性和效率方面均显著优于两种最先进的基线方法。MicroHECL已在阿里巴巴投入使用,实现了68%的top-3命中率,并将根因定位时间从30分钟缩短至5分钟。

英文摘要:

Availability issues of industrial microservice systems (e.g., drop of successfully placed orders and processed transactions) directly affect the running of the business. These issues are usually caused by various types of service anomalies which propagate along service dependencies. Accurate and high-efficient root cause localization is thus a critical challenge for large-scale industrial microservice systems. Existing approaches use service dependency graph based analysis techniques to automatically locate root causes. However, these approaches are limited due to their inaccurate detection of service anomalies and inefficient traversing of service dependency graph. In this paper, we propose a high-efficient root cause localization approach for availability issues of microservice systems, called MicroHECL. Based on a dynamically constructed service call graph, MicroHECL analyzes possible anomaly propagation chains, and ranks candidate root causes based on correlation analysis. We combine machine learning and statistical methods and design customized models for the detection of different types of service anomalies (i.e., performance, reliability, traffic). To improve the efficiency, we adopt a pruning strategy to eliminate irrelevant service calls in anomaly propagation chain analysis. Experimental studies show that MicroHECL significantly outperforms two state-of-the-art baseline approaches in terms of both accuracy and efficiency. MicroHECL has been used in Alibaba and achieves a top-3 hit ratio of 68% with root cause localization time reduced from 30 minutes to 5 minutes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑