arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2407.17545cs.SEcs.AIcs.CL
收藏

计算工作流异常检测的大型语言模型:从监督微调到上下文学习

Large Language Models for Anomaly Detection in Computational Workflows: from Supervised Fine-Tuning to In-Context Learning

Mathematics and Computer Science Division, Argonne National Laboratory(阿贡国家实验室数学与计算机科学部);Information Sciences Institute, University of Southern California(南加州大学信息科学研究所);RENCI, University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校RENCI)

Hongwei Jin, George Papadimitriou, Krishnan Raghavan, Pawel Zuk, Prasanna Balaprakash, Cong Wang, Anirban Mandal, Ewa Deelman

AI总结:

本文研究利用大型语言模型通过监督微调和上下文学习进行计算工作流异常检测,实验证明其在复杂执行中具有有效检测新型异常的潜力。

摘要:

计算工作流中的异常检测对确保系统可靠性和安全性至关重要。然而,传统的基于规则的方法难以检测新型异常。本文利用大型语言模型(LLMs)进行工作流异常检测,发挥其学习复杂数据模式的能力。研究调查了两种方法:1)监督微调(SFT),在标注数据上微调预训练的LLMs进行句子分类以识别异常;2)上下文学习(ICL),通过包含任务描述和示例的提示,引导LLMs在无需微调的情况下进行少样本异常检测。论文评估了SFT模型的性能、效率和泛化能力,并探索了零样本和少样本ICL提示,以及通过思维链提示增强可解释性。跨多个工作流数据集的实验表明,LLMs在复杂执行中具有有效异常检测的潜力。

英文摘要:

Anomaly detection in computational workflows is critical for ensuring system reliability and security. However, traditional rule-based methods struggle to detect novel anomalies. This paper leverages large language models (LLMs) for workflow anomaly detection by exploiting their ability to learn complex data patterns. Two approaches are investigated: 1) supervised fine-tuning (SFT), where pre-trained LLMs are fine-tuned on labeled data for sentence classification to identify anomalies, and 2) in-context learning (ICL) where prompts containing task descriptions and examples guide LLMs in few-shot anomaly detection without fine-tuning. The paper evaluates the performance, efficiency, generalization of SFT models, and explores zero-shot and few-shot ICL prompts and interpretability enhancement via chain-of-thought prompting. Experiments across multiple workflow datasets demonstrate the promising potential of LLMs for effective anomaly detection in complex executions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑