arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.08694cs.DCcs.AIcs.LG
收藏

Cloud Atlas:利用语言模型与因果洞察实现云系统的高效故障定位

Cloud Atlas: Efficient Fault Localization for Cloud Systems using Language Models and Causal Insight

Stanford University(斯坦福大学);Carnegie Mellon University(卡内基梅隆大学);Microsoft Research(微软研究院)

Zhiqiang Xie, Yujia Zheng, Lizi Ottens, Kun Zhang, Christos Kozyrakis, Jonathan Mace

AI总结:

针对云系统故障定位难、数据驱动因果发现方法因事件稀缺效果有限的问题,提出Atlas方法,借助LLM利用系统文档等生成因果图并结合数据验证,性能远超数据驱动算法、接近真实基准。

摘要:

在现代云系统中,运行时故障与性能下降是常见问题。对云服务提供商而言,自动确定事件的根本原因对保障高可靠性与可用性至关重要,因为快速的故障定位能推动更快的诊断与分诊,从而及时解决问题。近期研究探索的一种颇具潜力的方案是利用因果图进行因果推理,以捕捉云系统各类性能指标之间的关系。但该方案要发挥效用,系统开发人员必须正确定义其系统的因果图——这是一项耗时、脆弱且极具挑战的任务,对于大型动态系统难度会进一步提升,且需要领域专业知识。另一方面,自动化的数据驱动方法因云系统中事件本身的稀缺性,效果十分有限。在本研究中,我们提出了Atlas——一种为云系统自动生成因果图的新方法。Atlas借助大语言模型(LLMs),利用系统文档、遥测数据与部署反馈生成因果图。Atlas与数据驱动的因果发现技术具有互补性,我们还通过数据驱动的验证步骤进一步增强了Atlas的性能。我们在多种故障定位场景下对Atlas进行了评估,结果表明Atlas能够以可扩展、可泛化的方式生成因果图,其性能远超数据驱动算法,与真实基准(ground-truth baseline)相当。

英文摘要:

Runtime failure and performance degradation is commonplace in modern cloud systems. For cloud providers, automatically determining the root cause of incidents is paramount to ensuring high reliability and availability as prompt fault localization can enable faster diagnosis and triage for timely resolution. A compelling solution explored in recent work is causal reasoning using causal graphs to capture relationships between varied cloud system performance metrics. To be effective, however, systems developers must correctly define the causal graph of their system, which is a time-consuming, brittle, and challenging task that increases in difficulty for large and dynamic systems and requires domain expertise. Alternatively, automated data-driven approaches have limited efficacy for cloud systems due to the inherent rarity of incidents. In this work, we present Atlas, a novel approach to automatically synthesizing causal graphs for cloud systems. Atlas leverages large language models (LLMs) to generate causal graphs using system documentation, telemetry, and deployment feedback. Atlas is complementary to data-driven causal discovery techniques, and we further enhance Atlas with a data-driven validation step. We evaluate Atlas across a range of fault localization scenarios and demonstrate that Atlas is capable of generating causal graphs in a scalable and generalizable manner, with performance that far surpasses that of data-driven algorithms and is commensurate to the ground-truth baseline.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑