arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.00446cs.CR
收藏

DEHYDRATOR:通过分层编码与序列生成增强溯源图存储

DEHYDRATOR: Enhancing Provenance Graph Storage via Hierarchical Encoding and Sequence Generation

Jie Ying, Tiantian Zhu, Mingqi Lv, Tieming Chen

AI总结:

针对溯源图存储开销高的问题,本文提出 Dehydrator 系统,通过字段映射编码、分层编码和深度神经网络支持批量查询,在超十亿条日志上实现存储空间降低 84.55%,并显著优于 PostgreSQL、Neo4j 和 Leonard。

摘要:

随着网络威胁的范围和影响不断扩大,分析人员利用审计日志来搜寻威胁并调查攻击。由内核日志构建的溯源图因其强大的语义表达能力和攻击历史关联能力,越来越被视为理想的数据来源。然而,由于内核事件的高频性和攻击的持续性,使用传统数据库存储溯源图面临高存储开销的挑战。为了解决这一问题,我们提出了 Dehydrator,一个高效的溯源图存储系统。对于审计框架生成的日志,Dehydrator 使用字段映射编码来过滤字段级冗余,使用分层编码来过滤结构级冗余,最后学习一个深度神经网络以支持批量查询。我们在七个数据集上进行了评估,这些数据集总计超过十亿条日志记录。实验结果表明,Dehydrator 将存储空间减少了 84.55%。Dehydrator 的效率是 PostgreSQL 的 7.36 倍,是 Neo4j 的 7.16 倍,是 Leonard(与 Dehydrator 最相关的工作,发表于 Usenix Security'23)的 16.17 倍。

英文摘要:

As the scope and impact of cyber threats have expanded, analysts utilize audit logs to hunt threats and investigate attacks. The provenance graphs constructed from kernel logs are increasingly considered as an ideal data source due to their powerful semantic expression and attack historic correlation ability. However, storing provenance graphs with traditional databases faces the challenge of high storage overhead, given the high frequency of kernel events and the persistence of attacks. To address this, we propose Dehydrator, an efficient provenance graph storage system. For the logs generated by auditing frameworks, Dehydrator uses field mapping encoding to filter field-level redundancy, hierarchical encoding to filter structure-level redundancy, and finally learns a deep neural network to support batch querying. We have conducted evaluations on seven datasets totaling over one billion log entries. Experimental results show that Dehydrator reduces the storage space by 84.55%. Dehydrator is 7.36 times more efficient than PostgreSQL, 7.16 times than Neo4j, and 16.17 times than Leonard (the work most closely related to Dehydrator, published at Usenix Security'23).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑