所有错误都不相等:综合层次感知多标签预测(CHAMP)
All Mistakes Are Not Equal: Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP)
摘要:
本文考虑层次多标签分类(HMC)问题,其中(i)每个示例可以有多个标签,(ii)标签通过特定于域的层次树相关联。在所有错误都不相等的直觉指导下,我们提出了综合层次感知多标签预测(CHAMP),这是一个根据层次树的严重程度惩罚错误预测的框架。虽然已经有作品将这样的想法应用于单标签分类,但据我们所知,对于多标签分类,专注于错误严重性的此类作品有限。关键原因是,在多标签环境中,没有明确的方法来量化先验错误预测的严重程度。在这项工作中,我们提出了一个简单但有效的指标来量化HMC中错误的严重程度,自然导致CHAMP。在六个公共HMC数据集上进行的广泛实验(图像,音频和文本)表明,结合分层信息会带来实质性的收益,因为CHAMP改善了AUPRC(2.6%的中位数百分比改善)和分层指标(2.85%的中位数百分比改善),超过了独立的分层或多标签分类方法。与标准多标签基线相比,CHAMP在稳健性(平均百分比改善8.87%)和更少的数据机制方面提供了改进的AUPRC。此外,我们的方法提供了一个框架,以提高现有的多标签分类算法更好的错误(18.1%的平均百分比增量)。
英文摘要:
This paper considers the problem of Hierarchical Multi-Label Classification (HMC), where (i) several labels can be present for each example, and (ii) labels are related via a domain-specific hierarchy tree. Guided by the intuition that all mistakes are not equal, we present Comprehensive Hierarchy Aware Multi-label Predictions (CHAMP), a framework that penalizes a misprediction depending on its severity as per the hierarchy tree. While there have been works that apply such an idea to single-label classification, to the best of our knowledge, there are limited such works for multilabel classification focusing on the severity of mistakes. The key reason is that there is no clear way of quantifying the severity of a misprediction a priori in the multilabel setting. In this work, we propose a simple but effective metric to quantify the severity of a mistake in HMC, naturally leading to CHAMP. Extensive experiments on six public HMC datasets across modalities (image, audio, and text) demonstrate that incorporating hierarchical information leads to substantial gains as CHAMP improves both AUPRC (2.6% median percentage improvement) and hierarchical metrics (2.85% median percentage improvement), over stand-alone hierarchical or multilabel classification methods. Compared to standard multilabel baselines, CHAMP provides improved AUPRC in both robustness (8.87% mean percentage improvement ) and less data regimes. Further, our method provides a framework to enhance existing multilabel classification algorithms with better mistakes (18.1% mean percentage increment).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。