arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1212.0178stat.MEstat.AP
收藏

从间接测量估计网络上的潜在过程

Estimating latent processes on a network from indirect measurements

Edoardo M. Airoldi, Alexander W. Blocker

摘要:

在通信网络中,无论是在互联网服务提供商的规模还是在公司内部,随着时间的推移,点对点流量对于设计有效路由信息的协议以及维护安全性都是至关重要的。虽然技术上可行,但直接测量点对点流量会对网络性能造成沉重负担,通常不会实现。相反,会定期收集间接的总交通量。我们考虑的问题,估计点到点的业务量,x_t,从总的业务量,y_t,给定的信息编码在矩阵A的网络路由协议。这个估计任务可以重新表述为找到一系列不适定线性逆问题y_t = Ax_t的解,因为感兴趣的起点-目的地路线的数量高于可用的聚合测量的数量。在这里,我们介绍了一种新的多级状态空间模型的聚合交通量与现实的功能。我们实现了一个天真的策略,估计未观察到的点到点的流量从间接测量的总流量,基于粒子滤波。然后,我们开发了一个更有效的两阶段推理策略,依赖于基于模型的正则化:一个简单的模型被用来校准正则化参数,导致高效和可扩展的多级状态空间模型的推理。我们将我们的方法应用于企业和学术网络,在那里我们表明,所提出的推理策略优于现有的方法和规模更大的网络。我们也设计了一个模拟研究,以探讨影响性能的因素。我们的研究结果表明,基于模型的正则化可能是一个有效的策略,在其他复杂的多级模型的推理。

英文摘要:

In a communication network, point-to-point traffic volumes over time are critical for designing protocols that route information efficiently and for maintaining security, whether at the scale of an internet service provider or within a corporation. While technically feasible, the direct measurement of point-to-point traffic imposes a heavy burden on network performance and is typically not implemented. Instead, indirect aggregate traffic volumes are routinely collected. We consider the problem of estimating point-to-point traffic volumes, x_t, from aggregate traffic volumes, y_t, given information about the network routing protocol encoded in a matrix A. This estimation task can be reformulated as finding the solutions to a sequence of ill-posed linear inverse problems, y_t = A x_t, since the number of origin-destination routes of interest is higher than the number of aggregate measurements available. Here, we introduce a novel multilevel state-space model of aggregate traffic volumes with realistic features. We implement a naive strategy for estimating unobserved point-to-point traffic volumes from indirect measurements of aggregate traffic, based on particle filtering. We then develop a more efficient two-stage inference strategy that relies on model-based regularization: a simple model is used to calibrate regularization parameters that lead to efficient and scalable inference in the multilevel state-space model. We apply our methods to corporate and academic networks, where we show that the proposed inference strategy outperforms existing approaches and scales to larger networks. We also design a simulation study to explore the factors that influence the performance. Our results suggest that model-based regularization may be an efficient strategy for inference in other complex multilevel models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑