arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.09918cs.LG
收藏

概率化真正无序规则集

Probabilistic Truly Unordered Rule Sets

LIACS, Leiden University(莱顿大学LIACS)

Lincen Yang, Matthijs van Leeuwen

AI总结:

针对规则集存在顺序、难以处理概率冲突及多分类研究不足的问题,本文提出 TURS,利用概率输出相似性允许规则重叠,并基于 MDL 原则启发式学习真正无序的概率规则集。

摘要:

规则集学习因其可解释性,近来再次受到广泛关注。然而,现有方法存在若干不足。首先,大多数现有方法会在规则之间显式或隐式地施加顺序,这降低了模型的可理解性。其次,由于难以处理由重叠(即被多条规则覆盖的实例)引发的冲突,现有方法通常不考虑概率规则。第三,面向多分类目标学习分类规则的研究仍不充分,因为多数现有方法聚焦于二分类,或通过“一对其余”方法处理多分类。为解决这些不足,我们提出了 TURS,即 Truly Unordered Rule Sets(真正无序规则集)。为解决由规则重叠导致的冲突,我们提出了一种利用规则集概率性质的新模型,其直觉是:仅当规则具有相似的概率输出时,才允许它们重叠。随后,我们基于 MDL 原则形式化了学习 TURS 模型的问题,并开发了一种经过精心设计的启发式算法。我们与多种基于规则的方法进行了基准比较,结果表明,我们的方法学到的规则集具有更低的模型复杂度和极具竞争力的预测性能。此外,我们通过实验表明,模型中的规则在经验上是“独立的”,因此是真正无序的。

英文摘要:

Rule set learning has recently been frequently revisited because of its interpretability. Existing methods have several shortcomings though. First, most existing methods impose orders among rules, either explicitly or implicitly, which makes the models less comprehensible. Second, due to the difficulty of handling conflicts caused by overlaps (i.e., instances covered by multiple rules), existing methods often do not consider probabilistic rules. Third, learning classification rules for multi-class target is understudied, as most existing methods focus on binary classification or multi-class classification via the ``one-versus-rest" approach. To address these shortcomings, we propose TURS, for Truly Unordered Rule Sets. To resolve conflicts caused by overlapping rules, we propose a novel model that exploits the probabilistic properties of our rule sets, with the intuition of only allowing rules to overlap if they have similar probabilistic outputs. We next formalize the problem of learning a TURS model based on the MDL principle and develop a carefully designed heuristic algorithm. We benchmark against a wide range of rule-based methods and demonstrate that our method learns rule sets that have lower model complexity and highly competitive predictive performance. In addition, we empirically show that rules in our model are empirically ``independent" and hence truly unordered.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑