arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.03586cs.LGcs.AI
收藏

APEX:通过激活扰动探测神经网络

APEX: Probing Neural Networks via Activation Perturbation

Aalborg University(奥尔堡大学)

Tao Ren, Xiaoyu Luo, Qiongxiu Li

AI总结:

APEX通过激活扰动探测神经网络,揭示模型结构信息,区分结构化与随机标签模型,并揭示语义连贯的预测转变。

摘要:

先前对神经网络的探测工作主要依赖于输入空间分析或参数扰动,这两种方法在访问中间表示中编码的结构信息方面都面临根本性的限制。我们引入了激活扰动用于探索(APEX),这是一种在推理时的探测范式,通过扰动隐藏激活的同时保持输入和模型参数固定。我们理论证明,激活扰动诱导了一个从样本依赖性到模型依赖性的转变,通过抑制输入特定的信号并放大表示层面的结构。进一步建立输入扰动对应于该框架的受限特殊情况。通过代表性案例研究,我们展示了APEX的实用优势。在小噪声情况下,APEX提供了一种轻量且高效的样本规律度量,与已建立的度量一致,同时区分结构化与随机标记的模型,并揭示出语义上连贯的预测转变。在大噪声情况下,APEX暴露了训练引起的模型层面偏差,包括在后门模型中预测集中在目标类上的明显集中。总体而言,我们的结果表明,APEX提供了一种有效的方法来探索和理解神经网络,这超出了仅从输入空间可获得的范围。

英文摘要:

Prior work on probing neural networks primarily relies on input-space analysis or parameter perturbation, both of which face fundamental limitations in accessing structural information encoded in intermediate representations. We introduce Activation Perturbation for EXploration (APEX), an inference-time probing paradigm that perturbs hidden activations while keeping both inputs and model parameters fixed. We theoretically show that activation perturbation induces a principled transition from sample-dependent to model-dependent behavior by suppressing input-specific signals and amplifying representation-level structure, and further establish that input perturbation corresponds to a constrained special case of this framework. Through representative case studies, we demonstrate the practical advantages of APEX. In the small-noise regime, APEX provides a lightweight and efficient measure of sample regularity that aligns with established metrics, while also distinguishing structured from randomly labeled models and revealing semantically coherent prediction transitions. In the large-noise regime, APEX exposes training-induced model-level biases, including a pronounced concentration of predictions on the target class in backdoored models. Overall, our results show that APEX offers an effective perspective for exploring, and understanding neural networks beyond what is accessible from input space alone.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑