arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.13402cs.CRcs.AIcs.CL

借助命令行语言模型实现大规模入侵检测

Intrusion Detection at Scale with the Assistance of a Command-line Language Model

Sun Yat-sen University(中山大学);UC Davis(加利福尼亚大学戴维斯分校)

Jiongliang Lin, Yiwen Guo, Hao Chen

AI总结:

针对现有入侵检测系统泛化能力差且难以利用云环境大数据的问题,本文提出结合大规模预训练的入侵检测系统,基于数千万命令行训练大型语言模型,并在千万级样本实验中验证了其有效性。

摘要:

入侵检测是安全领域长期存在且至关重要的问题。企业安全解决方案对能够自动检测入侵的系统有着巨大需求。现有解决方案严重依赖安全操作员手工设计的规则,这些规则存在高漏报率,且在大规模应对新型零日攻击时泛化能力差。AI和机器学习通过智能且自动地从数据中检查异常用户行为,为解决这些问题提供了有前景的方案。然而,文献中现有的基于学习的入侵检测系统大多针对小数据设计,缺乏在云环境中利用大数据力量的能力。在本文中,我们针对这一问题,引入了一个结合大规模预训练的入侵检测系统,以基于数千万条命令行训练大型语言模型,用于基于AI的入侵检测。在3000万训练样本和1000万测试样本上进行的实验验证了我们解决方案的有效性。

英文摘要:

Intrusion detection is a long standing and crucial problem in security. A system capable of detecting intrusions automatically is on great demand in enterprise security solutions. Existing solutions rely heavily on hand-crafted rules designed by security operators, which suffer from high false negative rates and poor generalization ability to new, zero-day attacks at scale. AI and machine learning offer promising solutions to address the issues, by inspecting abnormal user behaviors intelligently and automatically from data. However, existing learning-based intrusion detection systems in the literature are mostly designed for small data, and they lack the ability to leverage the power of big data in cloud environments. In this paper, we target at this problem and introduce an intrusion detection system which incorporates large-scale pre-training, so as to train a large language model based on tens of millions of command lines for AI-based intrusion detection. Experiments performed on 30 million training samples and 10 million test samples verify the effectiveness of our solution.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑