计算工作流异常检测的大型语言模型:从监督微调到上下文学习
Large Language Models for Anomaly Detection in Computational Workflows: from Supervised Fine-Tuning to In-Context Learning
AI总结:
本文研究利用大型语言模型通过监督微调和上下文学习进行计算工作流异常检测,实验证明其在复杂执行中具有有效检测新型异常的潜力。
摘要:
计算工作流中的异常检测对确保系统可靠性和安全性至关重要。然而,传统的基于规则的方法难以检测新型异常。本文利用大型语言模型(LLMs)进行工作流异常检测,发挥其学习复杂数据模式的能力。研究调查了两种方法:1)监督微调(SFT),在标注数据上微调预训练的LLMs进行句子分类以识别异常;2)上下文学习(ICL),通过包含任务描述和示例的提示,引导LLMs在无需微调的情况下进行少样本异常检测。论文评估了SFT模型的性能、效率和泛化能力,并探索了零样本和少样本ICL提示,以及通过思维链提示增强可解释性。跨多个工作流数据集的实验表明,LLMs在复杂执行中具有有效异常检测的潜力。
英文摘要:
Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for workflow anomaly detection by exploiting their ability to learn complex data patterns. Two approaches are investigated: 1) supervised fine-tuning (SFT), where pre-trained LLMs are fine-tuned on labeled data for sentence classification to identify anomalies, and 2) in-context learning (ICL) where prompts containing task descriptions and examples guide LLMs in few-shot anomaly detection without fine-tuning. The paper evaluates the performance, efficiency, generalization of SFT models, and explores zero-shot and few-shot ICL prompts and interpretability enhancement via chain-of-thought prompting. Experiments across multiple workflow datasets demonstrate the promising potential of LLMs for effective anomaly detection in complex executions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。