具有流混合的均值掩码自编码器用于加密流量分类
Mean Masked Autoencoder with Flow-Mixing for Encrypted Traffic Classification
AI总结:
本文提出Mean MAE,通过流混合策略和自蒸馏机制提升加密流量分类的多粒度理解能力,实验表明其在多个数据集上达到最优性能。
摘要:
基于掩码自编码器(MAE)的网络流量分类自监督预训练模型已展现出巨大潜力。然而,现有方法局限于孤立的字节级流重建,缺乏对流量多粒度上下文关系的充分感知。为此,我们提出Mean MAE(MMAE),一种具有流混合策略的教师-学生MAE范式,用于构建加密流量预训练模型。MMAE采用自蒸馏机制进行教师-学生交互,其中教师提供未掩码的流级语义监督,推动学生从局部字节重建到多粒度理解。为打破单个流的信息瓶颈,我们引入动态流混合(FlowMix)策略取代传统随机掩码机制。通过构建具有干扰的跨流混合样本,迫使模型从扭曲的标记中学习判别性表示。此外,我们设计了具有注意力偏差机制的包重要性感知掩码预测器(PMP),利用包级侧信道统计信息动态掩码高语义密度的标记。在多个涵盖加密应用、恶意软件和攻击流量的数据集上,实验表明MMAE实现了最先进的性能。代码可在https://github.com/lx6c78/MMAE获取。
英文摘要:
Network traffic classification using self-supervised pre-training models based on Masked Autoencoders (MAE) has demonstrated a huge potential. However, existing methods are confined to isolated byte-level reconstruction of individual flows, lacking adequate perception of the multi-granularity contextual relationship in traffic. To address this limitation, we propose Mean MAE (MMAE), a teacher-student MAE paradigm with flow mixing strategy for building encrypted traffic pre-training model. MMAE employs a self-distillation mechanism for teacher-student interaction, where the teacher provides unmasked flow-level semantic supervision to advance the student from local byte reconstruction to multi-granularity comprehension. To break the information bottleneck in individual flows, we introduce a dynamic Flow Mixing (FlowMix) strategy to replace traditional random masking mechanism. By constructing challenging cross-flow mixed samples with interferences, it compels the model to learn discriminative representations from distorted tokens. Furthermore, we design a Packet-importance aware Mask Predictor (PMP) equipped with an attention bias mechanism that leverages packet-level side-channel statistics to dynamically mask tokens with high semantic density. Numerous experiments on a number of datasets covering encrypted applications, malware, and attack traffic demonstrate that MMAE achieves state-of-the-art performance. The code is available at https://github.com/lx6c78/MMAE
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。