实时捕获请求执行路径进行异常检测
Transparently Capturing Request Execution Path for Anomaly Detection
摘要:
随着云系统和大数据分析平台的规模和复杂性的增加,理解和诊断这种分布式平台中的服务请求的处理变得越来越具有挑战性。一种有助于处理此问题的方法是准确地捕获所有相关组件之间的服务请求的完整端到端执行路径。本文介绍了REPTrace,一个通用的方法来捕捉这样的执行路径在一个透明的方式。我们分析了一个全面的执行场景列表,并提出了原则和算法,为所有的场景生成端到端的请求执行路径。此外,本文提出了一种异常检测方法,利用请求执行路径来检测异常的执行过程中的请求处理。在四个不同负载的分布式平台上的实验表明,REPTrace能够透明地捕获请求执行路径,且具有合理的延迟和可忽略的网络开销。故障注入实验表明,执行异常检测具有较高的召回率(96%)。
英文摘要:
With the increasing scale and complexity of cloud systems and big data analytics platforms, it is becoming more and more challenging to understand and diagnose the processing of a service request in such distributed platforms. One way that helps to deal with this problem is to capture the complete end-to-end execution path of service requests among all involved components accurately. This paper presents REPTrace, a generic methodology for capturing such execution paths in a transparent fashion. We analyze a comprehensive list of execution scenarios, and propose principles and algorithms for generating the end-to-end request execution path for all the scenarios. Moreover, this paper presents an anomaly detection approach exploiting request execution paths to detect anomalies of the execution during request processing. The experiments on four popular distributed platforms with different workloads show that REPTrace can transparently capture the accurate request execution path with reasonable latency and negligible network overhead. Fault injection experiments show that execution anomalies are detected with high recall (96%).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。