arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.04599cs.AI
收藏

提升图模型结构学习的原理性高效基序发现方法

Principled and Efficient Motif Finding for Structure Learning of Lifted Graphical Models

University of Edinburgh(爱丁堡大学);Samsung AI(三星人工智能)

Jonathan Feldstein, Dominic Phillips, Efthymia Tsamoura

AI总结:

本文提出一种基于随机过程度量实体相似性的原理性基序挖掘方法,用于提升图模型的结构学习,通过层次聚类预处理和高效聚类算法,在准确率和运行时间上分别最多提升6%和80%。

摘要:

结构学习是人工智能中的一个核心问题,对神经符号人工智能和统计关系学习领域至关重要。它涉及从数据中自动学习逻辑理论。结构学习的基础是挖掘数据中的重复模式,即结构基序。发现这些模式可以缩减指数级搜索空间,从而指导公式的学习。尽管基序学习很重要,但它仍未被充分理解。我们提出了第一种在提升图模型(一种将一阶逻辑与概率模型相结合的语言)中挖掘结构基序的原理性方法,该方法使用随机过程来度量数据中实体的相似性。我们的第一个贡献是一种算法,它依赖于两个直观的超参数:一个控制实体相似性度量中的不确定性,另一个控制所得规则的软性。我们的第二个贡献是一个预处理步骤,在该步骤中我们对数据进行层次聚类,以将搜索空间缩减到最相关的数据。我们的第三个贡献是引入了一种 O(n ln n)(其中 n 为数据中实体数量)的算法,用于对结构相关的数据进行聚类。我们使用标准基准评估了我们的方法,并表明在准确率方面,我们比最先进的结构学习方法最多提高 6%,在运行时间方面最多提高 80%。

英文摘要:

Structure learning is a core problem in AI central to the fields of neuro-symbolic AI and statistical relational learning. It consists in automatically learning a logical theory from data. The basis for structure learning is mining repeating patterns in the data, known as structural motifs. Finding these patterns reduces the exponential search space and therefore guides the learning of formulas. Despite the importance of motif learning, it is still not well understood. We present the first principled approach for mining structural motifs in lifted graphical models, languages that blend first-order logic with probabilistic models, which uses a stochastic process to measure the similarity of entities in the data. Our first contribution is an algorithm, which depends on two intuitive hyperparameters: one controlling the uncertainty in the entity similarity measure, and one controlling the softness of the resulting rules. Our second contribution is a preprocessing step where we perform hierarchical clustering on the data to reduce the search space to the most relevant data. Our third contribution is to introduce an O(n ln n) (in the size of the entities in the data) algorithm for clustering structurally-related data. We evaluate our approach using standard benchmarks and show that we outperform state-of-the-art structure learning approaches by up to 6% in terms of accuracy and up to 80% in terms of runtime.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑