arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.07303cs.DBcs.AIcs.SE
收藏

KRONE:通过层次抽象实现可扩展的LLM增强日志异常检测

KRONE: Scalable LLM-Augmented Log Anomaly Detection via Hierarchical Abstraction

Worcester Polytechnic Institute(沃斯特理工学院);ByteDance Inc.(字节跳动公司);University of Arizona(亚利桑那大学)

Lei Ma, Jinyang Liu, Tieying Zhang, Peter M. VanNostrand, Dennis M. Hofmann, Lei Cao, Elke A. Rundensteiner, Jianjun Chen

AI总结:

KRONE通过自动从扁平日志中推导执行层次结构,实现模块化多级异常检测,提升准确率、F1分数和资源效率。

摘要:

日志异常检测对于发现系统故障和安全风险至关重要。尽管日志来源于具有明确边界的嵌套组件执行,但存储为扁平序列时会丢失这种结构。因此,最先进的方法在学习无关事件之间的虚假相关性时往往错过执行内的真实依赖关系。我们提出了KRONE,第一个层次异常检测框架,能够从扁平日志中自动推导执行层次结构,以实现模块化、多级异常检测。在核心,KRONE日志抽象模型提取应用特定的语义层次结构,用于递归分解日志序列到连贯的执行单元,称为KRONE序列。这将序列级检测转化为一组模块化的KRONE序列级检测任务。对于每个测试KRONE序列,KRONE采用混合模块化检测策略,通过在高效水平无关本地上下文检测器和捕捉跨层语义依赖的嵌套感知检测器之间路由,结合基于LLM的异常检测和解释。KRONE进一步通过缓存结果重用和层次中的早期退出策略优化检测。在三个公开基准和一个来自字节跳动云的工业数据集上的实验表明,KRONE在准确性(42.49%到87.98%)、F1分数、数据效率(117.3倍减少)、资源效率(43.7倍减少)和可解释性方面实现了显著改进。KRONE在F1分数上比先前方法提高了10.07%(82.76%到92.83%),同时将LLM使用量减少到测试数据的1.1%到3.3%。代码:https://github.com/LeiMa0324/KRONE 演示:https://leima0324.github.io/KRONE_Demo_official/

英文摘要:

Log anomaly detection is crucial for uncovering system failures and security risks. Although logs originate from nested component executions with clear boundaries, this structure is lost when stored as flat sequences. As a result, state-of-the-art methods often miss true dependencies within executions while learning spurious correlations across unrelated events. We propose KRONE, the first hierarchical anomaly detection framework that automatically derives execution hierarchies from flat logs to enable modular, multi-level anomaly detection. At its core, the KRONE Log Abstraction Model extracts application-specific semantic hierarchies, which are used to recursively decompose log sequences into coherent execution units, referred to as KRONE Seqs. This transforms sequence-level detection into a set of modular KRONE Seq-level detection tasks. For each test KRONE Seq, KRONE adopts a hybrid modular detection strategy that routes between an efficient level-independent Local-Context detector for rapid filtering and a Nested-Aware detector that captures cross-level semantic dependencies, augmented with LLM-based anomaly detection and explanation. KRONE further optimizes detection through cached result reuse and early-exit strategies along the hierarchy. Experiments on three public benchmarks and one industrial dataset from ByteDance Cloud demonstrate that KRONE achieves substantial improvements in accuracy (42.49% to 87.98%), F1 score, data efficiency (117.3x reduction), resource efficiency (43.7x reduction), and interpretability. KRONE improves F1-score by 10.07% (82.76% to 92.83%) over prior methods while reducing LLM usage to only 1.1% to 3.3% of the test data. Code: https://github.com/LeiMa0324/KRONE Demo: https://leima0324.github.io/KRONE_Demo_official/

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑