arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.02856cs.LGcs.CR
收藏

早期异常检测:模型在完整流与部分流上的性能研究

Early-Stage Anomaly Detection: A Study of Model Performance on Complete vs. Partial Flows

Budapest University of Technology and Economics(布达佩斯技术大学);HUN-REN-BME Information Systems Research Group(HUN-REN-BME信息系统研究组);CUJO LLC(CUJO公司)

Adrian Pekar, Richard Jozsa

AI总结:

本研究评估了Random Forest模型在完整流与部分流不同训练测试条件下的网络安全威胁检测性能,发现完整流训练模型在部分流测试时精确率和召回率最多下降30%,并确定约7个数据包为维持可靠检测的最小阈值。

摘要:

本研究通过部分流与完整流信息的关键视角,调查了机器学习模型在网络安全威胁检测中的效能,填补了研究环境与实时操作需求之间的常见空白。我们系统评估了标准基准模型Random Forest在不同训练和测试条件(完整/完整、部分/部分、完整/部分)下的表现,量化了在处理实时环境中典型不完整数据时的性能影响。结果表明存在显著的性能差异,当在完整流上训练的模型针对部分流进行测试时,在某些条件下精确率和召回率下降高达30%。研究还揭示,对于所评估的数据集和模型,测试集中约7个数据包的最小阈值似乎是维持可靠检测率的必要条件,为开发更现实的实时检测策略提供了有价值的量化见解。

英文摘要:

This study investigates the efficacy of machine learning models in network security threat detection through the critical lens of partial versus complete flow information, addressing a common gap between research settings and real-time operational needs. We systematically evaluate how a standard benchmark model, Random Forest, performs under varying training and testing conditions (complete/complete, partial/partial, complete/partial), quantifying the performance impact when dealing with the incomplete data typical in real-time environments. Our findings demonstrate a significant performance difference, with precision and recall dropping by up to 30% under certain conditions when models trained on complete flows are tested against partial flows. The study also reveals that, for the evaluated dataset and model, a minimum threshold around 7 packets in the test set appears necessary for maintaining reliable detection rates, providing valuable, quantified insights for developing more realistic real-time detection strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑