arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1809.02613cs.ITcs.CRcs.PLmath.IT
收藏

互信息的混合统计估计及其在信息流中的应用

Hybrid Statistical Estimation of Mutual Information and its Application to Information Flow

Fabrizio Biondi, Yusuke Kawamoto, Axel Legay, Louis-Marie Traonouez

AI总结:

本文提出结合精确与统计分析的混合方法,用于估计互信息、Shannon熵和条件熵及置信区间,并通过HyLeak工具和案例研究证明其在信息泄漏量化上优于现有方法。

摘要:

对概率系统的分析通常需要学习其随机变量的联合概率分布。精确分布的计算通常是对系统所有执行情况进行穷尽的精确分析。为避免这种穷尽搜索的高昂计算代价,人们研究了统计分析,通过仅分析系统行为中一个小但具有代表性的子集来高效获得近似估计。本文提出一种混合统计估计方法,将精确分析与统计分析相结合,用于估计互信息、Shannon熵和条件熵,以及它们的置信区间。我们展示了如何以不同精度组合对离散系统不同组件的分析,从而获得整个系统的估计。该新方法执行加权统计分析,在不同组件上采用不同样本量,并动态寻找其最优样本量。此外,它能够利用关于系统的先验知识以及一种基于定性分析的新的“先抽象后采样”技术来减少样本量。为了将该方法应用于系统的源代码,我们通过概述这些技术在HyLeak工具中的实现,展示了如何将代码分解为组件,并为每个组件确定分析方法。我们通过案例研究证明,在量化信息泄漏方面,该新方法优于现有最先进技术。

英文摘要:

Analysis of a probabilistic system often requires to learn the joint probability distribution of its random variables. The computation of the exact distribution is usually an exhaustive precise analysis on all executions of the system. To avoid the high computational cost of such an exhaustive search, statistical analysis has been studied to efficiently obtain approximate estimates by analyzing only a small but representative subset of the system's behavior. In this paper we propose a hybrid statistical estimation method that combines precise and statistical analyses to estimate mutual information, Shannon entropy, and conditional entropy, together with their confidence intervals. We show how to combine the analyses on different components of a discrete system with different accuracy to obtain an estimate for the whole system. The new method performs weighted statistical analysis with different sample sizes over different components and dynamically finds their optimal sample sizes. Moreover, it can reduce sample sizes by using prior knowledge about systems and a new abstraction-then-sampling technique based on qualitative analysis. To apply the method to the source code of a system, we show how to decompose the code into components and to determine the analysis method for each component by overviewing the implementation of those techniques in the HyLeak tool. We demonstrate with case studies that the new method outperforms the state of the art in quantifying information leakage.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑