arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.15472cs.LG
收藏

FAIR:自动归纳规则的过滤

FAIR: Filtering of Automatically Induced Rules

Indian Institute of Technology Bombay(印度理工学院孟买分校);Vizzhy Inc(维兹希公司)

Divya Jyoti Bajpai, Ayush Maheshwari, Manjesh Kumar Hanawal, Ganesh Ramakrishnan

AI总结:

本文提出FAIR算法,利用考虑精度、覆盖率和冲突的子模块目标函数过滤自动归纳规则,在多个ARI方法和文本分类数据集上验证了其优于现有半监督标签聚合与规则过滤方法的性能。

摘要:

大规模标注数据的可用性可能是成功训练机器学习算法的关键瓶颈,尤其是在应用于多样领域时。弱监督通过利用领域特定规则加速标注训练数据的创建,提供了一种有前景的替代方案。然而,它要求用户编写多样且高质量的规则来为未标注数据分配标签。自动规则归纳(ARI)方法通过在小型标注集上根据特征自动创建规则,并从中过滤出最终规则集来规避这一问题。在ARI方法中,关键步骤是从大量自动创建的规则中过滤出一组高质量的有用规则子集。在本文中,我们提出了一种算法(自动归纳规则的过滤,FAIR),利用考虑规则集整体精度、覆盖率和冲突的子模块目标函数,从大量自动归纳的规则中过滤规则。我们使用三种ARI方法和五个文本分类数据集进行实验,以验证我们的算法相对于若干半监督标签聚合方法的优越性能。此外,我们表明,与现有规则过滤方法相比,FAIR取得了具有统计显著性的结果。

英文摘要:

The availability of large annotated data can be a critical bottleneck in training machine learning algorithms successfully, especially when applied to diverse domains. Weak supervision offers a promising alternative by accelerating the creation of labeled training data using domain-specific rules. However, it requires users to write a diverse set of high-quality rules to assign labels to the unlabeled data. Automatic Rule Induction (ARI) approaches circumvent this problem by automatically creating rules from features on a small labeled set and filtering a final set of rules from them. In the ARI approach, the crucial step is to filter out a set of a high-quality useful subset of rules from the large set of automatically created rules. In this paper, we propose an algorithm (Filtering of Automatically Induced Rules) to filter rules from a large number of automatically induced rules using submodular objective functions that account for the collective precision, coverage, and conflicts of the rule set. We experiment with three ARI approaches and five text classification datasets to validate the superior performance of our algorithm with respect to several semi-supervised label aggregation approaches. Further, we show that achieves statistically significant results in comparison to existing rule-filtering approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑