arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.16308cs.LGcs.AIcs.CL
收藏

利用大语言模型(LLMs)进行表格数据异常检测

Anomaly Detection of Tabular Data Using LLMs

UC Irvine(加州大学欧文分校);Bosch Center for AI(博世人工智能中心);RPTU Kaiserslautern-Landau(凯撒斯劳滕-兰道工业大学)

Aodong Li, Yunhan Zhao, Chen Qiu, Marius Kloft, Padhraic Smyth, Maja Rudolph, Stephan Mandt

AI总结:

本研究验证了预训练LLMs可作为零样本批次级表格异常检测器,还提出合成数据集加端到端微调的策略提升其任务对齐能力,实验证明GPT-4性能与现有最优转导学习方法相当。

摘要:

大语言模型(LLMs)已在长上下文理解和数学推理方面展现出潜力。本文研究了利用LLMs检测表格异常的问题,并证明预训练LLMs是零样本批次级异常检测器。也就是说,无需额外的特定分布模型拟合,它们就能在一批数据中发现隐藏的离群点,展现出识别低密度数据区域的能力。针对那些与异常检测任务对齐不佳、且频繁输出事实性错误的LLMs,我们采用简单却有效的数据生成过程来模拟合成的批次级异常检测数据集,并提出一种端到端微调策略以激发LLMs检测真实异常的潜力。在大型异常检测基准(ODDS)上的实验表明:i)GPT-4的性能与基于转导学习的最先进异常检测方法相当;ii)我们的合成数据集和微调策略在使LLMs对齐该任务方面具有有效性。

英文摘要:

Large language models (LLMs) have shown their potential in long-context understanding and mathematical reasoning. In this paper, we study the problem of using LLMs to detect tabular anomalies and show that pre-trained LLMs are zero-shot batch-level anomaly detectors. That is, without extra distribution-specific model fitting, they can discover hidden outliers in a batch of data, demonstrating their ability to identify low-density data regions. For LLMs that are not well aligned with anomaly detection and frequently output factual errors, we apply simple yet effective data-generating processes to simulate synthetic batch-level anomaly detection datasets and propose an end-to-end fine-tuning strategy to bring out the potential of LLMs in detecting real anomalies. Experiments on a large anomaly detection benchmark (ODDS) showcase i) GPT-4 has on-par performance with the state-of-the-art transductive learning-based anomaly detection methods and ii) the efficacy of our synthetic dataset and fine-tuning strategy in aligning LLMs to this task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑