arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.07762stat.MLcs.LGmath.CO
收藏

稀疏特定上下文系统的可扩展结构学习

Scalable Structure Learning for Sparse Context-Specific Systems

KTH Royal Institute of Technology(瑞典皇家理工学院)

Felix Leopoldo Rios, Alex Markham, Liam Solus

AI总结:

提出一种可扩展到数百变量的特定上下文模型结构学习算法,结合基于顺序的马尔可夫链蒙特卡洛搜索与特定上下文稀疏性假设,在准确性和可扩展性上表现良好。

摘要:

目前已经提出了几种图形化表示联合分布的分类变量之间特定上下文关系的方法,以及相应的结构学习算法。由于特定上下文模型的数量庞大,现有的基于优化的方法可扩展性有限,而基于约束的方法甚至比基于约束的有向无环图学习算法更容易出错,因为需要测试更多的关系。我们提出了一种学习特定上下文模型的算法,该算法可扩展到数百个变量。可扩展的学习是通过结合基于顺序的马尔可夫链蒙特卡洛搜索和一种新颖的特定上下文稀疏性假设来实现的,该假设类似于通常为有向无环图模型所引入的假设。与以前的马尔可夫链蒙特卡洛搜索方法不同,我们的马尔可夫链保证将变量排序的真实后验分布作为平稳分布。为了实现该方法,我们解决了 Alon 和 Balogh 最近提出的一个开放问题的第一个实例。未来解决该问题更一般实例的工作将使我们的方法能够学习越来越密集的模型。结果表明,该方法在合成数据和真实世界示例上均表现出色,在准确性和可扩展性方面均表现良好。

英文摘要:

Several approaches to graphically representing context-specific relations among jointly distributed categorical variables have been proposed, along with structure learning algorithms. While existing optimization-based methods have limited scalability due to the large number of context-specific models, the constraint-based methods are more prone to error than even constraint-based directed acyclic graph learning algorithms since more relations must be tested. We present an algorithm for learning context-specific models that scales to hundreds of variables. Scalable learning is achieved through a combination of an order-based Markov chain Monte-Carlo search and a novel, context-specific sparsity assumption that is analogous to those typically invoked for directed acyclic graphical models. Unlike previous Markov chain Monte-Carlo search methods, our Markov chain is guaranteed to have the true posterior of the variable orderings as the stationary distribution. To implement the method, we solve a first case of an open problem recently posed by Alon and Balogh. Future work solving increasingly general instances of this problem would allow our methods to learn increasingly dense models. The method is shown to perform well on synthetic data and real world examples, in terms of both accuracy and scalability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑