arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.08473cs.CR
收藏

组装网络范围以评估人工智能/机器学习(AI/ML)安全工具

Assembling a Cyber Range to Evaluate Artificial Intelligence / Machine Learning (AI/ML) Security Tools

Jeffrey A. Nichols, Kevin D. Spakes, Cory L. Watson, Robert A. Bridges

摘要:

在这个案例研究中,我们描述了在橡树岭,田纳西州,美国橡树岭国家实验室的网络安全测试平台的设计和组装。该系列旨在提供敏捷的重新配置,以促进各种网络安全工具评估实验-特别是涉及AI/ML的实验。特别地,该试验台提供了真实的试验环境,同时允许在实验期间进行控制和编程观察/数据汇集。我们设计了重复评估的能力,因此可以在以后评估和比较其他工具。该系统是一个可以按比例放大或缩小的实验规模。在会议召开时,我们将完成两个全面的,国家的,政府的挑战,这一范围。这些挑战是评估基于AI/ML的网络安全工具的性能和运营成本,以应用于大型政府规模的网络。这些评估将被描述为例子,为我们所做的各种设计决策和调整提供动力和背景。第一个挑战是针对10万个文件样本(良性软件和恶意软件)测量端点安全工具,这些样本是在一系列文件类型中选择的。第二个是评估网络入侵检测系统在识别多步骤对抗活动中的功效-涉及侦察,渗透和利用,横向移动等-在高容量的业务网络中具有不同的隐蔽性水平。这些挑战的规模要求自动化系统重复或同时镜像每个测试中的ML工具的相同实验。提供一系列从容易到困难的恶意活动来了解AI/ML工具的真正能力,是设计和执行这些挑战事件的一个特别有趣和具有挑战性的方面。

英文摘要:

In this case study, we describe the design and assembly of a cyber security testbed at Oak Ridge National Laboratory in Oak Ridge, TN, USA. The range is designed to provide agile reconfigurations to facilitate a wide variety of experiments for evaluations of cyber security tools -- particularly those involving AI/ML. In particular, the testbed provides realistic test environments while permitting control and programmatic observations/data collection during the experiments. We have designed in the ability to repeat the evaluations, so additional tools can be evaluated and compared at a later time. The system is one that can be scaled up or down for experiment sizes. At the time of the conference we will have completed two full-scale, national, government challenges on this range. These challenges are evaluating the performance and operating costs for AI/ML-based cyber security tools for application into large, government-sized networks. These evaluations will be described as examples providing motivation and context for various design decisions and adaptations we have made. The first challenge measured end-point security tools against 100K file samples (benignware and malware) chosen across a range of file types. The second is an evaluation of network intrusion detection systems efficacy in identifying multi-step adversarial campaigns -- involving reconnaissance, penetration and exploitations, lateral movement, etc. -- with varying levels of covertness in a high-volume business network. The scale of each of these challenges requires automation systems to repeat, or simultaneously mirror identical the experiments for each ML tool under test. Providing an array of easy-to-difficult malicious activity for sussing out the true abilities of the AI/ML tools has been a particularly interesting and challenging aspect of designing and executing these challenge events.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑