arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1301.6683cs.AIcs.LG
收藏

发现复杂动态系统的隐藏结构

Discovering the Hidden Structure of Complex Dynamic Systems

Stanford University(斯坦福大学);Hebrew University(希伯来大学)

Xavier Boyen, Nir Friedman, Daphne Koller

摘要:

动态贝叶斯网络为复杂的动态系统提供了一种紧凑而自然的表示方法。然而,在许多情况下,没有专家可以提供模型。学习为构造动态系统模型提供了一种替代方法。在本文中,我们解决了一些关键的计算方面的学习动态系统的结构,特别是那些相关的变量是部分观察,甚至完全未知。我们的方法是基于结构期望最大化(SEM)算法。SEM算法的主要计算成本是收集预期的足够的统计数据。我们提出了一种新的近似方案,使这些足够的统计数据被有效地计算。我们还调查的根本问题,发现隐藏变量的存在,而不详尽和昂贵的搜索。我们的方法是基于观察,在动态系统中,忽略一个隐藏的变量通常会导致违反马尔可夫性质。因此,我们的算法在数据中搜索这种违规行为,并引入隐藏变量来解释它们。我们提供的实证结果表明,该算法能够学习复杂系统的动力学在计算上易于处理的方式。

英文摘要:

Dynamic Bayesian networks provide a compact and natural representation for complex dynamic systems. However, in many cases, there is no expert available from whom a model can be elicited. Learning provides an alternative approach for constructing models of dynamic systems. In this paper, we address some of the crucial computational aspects of learning the structure of dynamic systems, particularly those where some relevant variables are partially observed or even entirely unknown. Our approach is based on the Structural Expectation Maximization (SEM) algorithm. The main computational cost of the SEM algorithm is the gathering of expected sufficient statistics. We propose a novel approximation scheme that allows these sufficient statistics to be computed efficiently. We also investigate the fundamental problem of discovering the existence of hidden variables without exhaustive and expensive search. Our approach is based on the observation that, in dynamic systems, ignoring a hidden variable typically results in a violation of the Markov property. Thus, our algorithm searches for such violations in the data, and introduces hidden variables to explain them. We provide empirical results showing that the algorithm is able to learn the dynamics of complex systems in a computationally tractable way.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑