arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.16674cs.LGcs.AI
收藏

真实世界分类任务中的神经符号规则学习

Neuro-symbolic Rule Learning in Real-world Classification Tasks

Imperial College London(帝国理工学院)

Kexin Gu Baugh, Nuri Cingillioglu, Alessandra Russo

AI总结:

本文扩展了neural DNF模块以支持真实世界多分类和多标签任务,提出neural DNF-EO模型强制互斥性,在保持与神经网络相当性能的同时提供更好可解释性和可扩展性。

摘要:

神经符号规则学习引起了广泛关注,因为它比纯神经模型具有更好的可解释性,且比符号规则学习具有更好的可扩展性。最近一种名为pix2rule的方法提出了一个神经析取范式(neural DNF)模块,利用前馈层来学习符号规则。尽管在合成的二分类任务中被证明有效,但pix2rule尚未应用于更具挑战性的任务,例如在真实世界数据上的多标签和多分类任务。在本文中,我们通过扩展neural DNF模块来解决这一局限性,以支持真实世界多分类和多标签分类任务中的规则学习,在多分类中强制执行互斥的符号属性(即恰好预测一个类别),并探索其在大规模输入和输出上的可扩展性。我们训练了一个类似于pix2rule的neural DNF模块的普通neural DNF模型用于多标签分类,并提出了一种名为neural DNF-EO(Exactly One)的新型扩展模型,该模型在多分类中强制执行互斥性。我们评估了基于neural DNF的模型的分类性能、可扩展性和可解释性,并将它们与纯神经模型以及名为FastLAS的最先进符号规则学习器进行了比较。我们证明,基于neural DNF的模型表现与神经网络相似,但通过能够提取逻辑规则提供了更好的可解释性。当规则搜索空间增大时,我们的模型也表现出良好的可扩展性,相比之下,FastLAS在具有200个类别的多分类任务和所有多标签设置中均无法学习。

英文摘要:

Neuro-symbolic rule learning has attracted lots of attention as it offers better interpretability than pure neural models and scales better than symbolic rule learning. A recent approach named pix2rule proposes a neural Disjunctive Normal Form (neural DNF) module to learn symbolic rules with feed-forward layers. Although proved to be effective in synthetic binary classification, pix2rule has not been applied to more challenging tasks such as multi-label and multi-class classifications over real-world data. In this paper, we address this limitation by extending the neural DNF module to (i) support rule learning in real-world multi-class and multi-label classification tasks, (ii) enforce the symbolic property of mutual exclusivity (i.e. predicting exactly one class) in multi-class classification, and (iii) explore its scalability over large inputs and outputs. We train a vanilla neural DNF model similar to pix2rule's neural DNF module for multi-label classification, and we propose a novel extended model called neural DNF-EO (Exactly One) which enforces mutual exclusivity in multi-class classification. We evaluate the classification performance, scalability and interpretability of our neural DNF-based models, and compare them against pure neural models and a state-of-the-art symbolic rule learner named FastLAS. We demonstrate that our neural DNF-based models perform similarly to neural networks, but provide better interpretability by enabling the extraction of logical rules. Our models also scale well when the rule search space grows in size, in contrast to FastLAS, which fails to learn in multi-class classification tasks with 200 classes and in all multi-label settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑