一种可靠层次文本分类的路径可信度评估方法
A Route Confidence Evaluation Method for Reliable Hierarchical Text Categorization
摘要:
随着万维网上文本数据量的快速增长,层次文本分类(HTC)变得越来越重要。在提出的不同的策略,以应付HTC,本地分类器每节点(LCN)的方法达到了良好的性能,通过镜像底层类层次结构,同时在测试步骤中执行自顶向下的策略。然而,嵌入层次信息(父子关系),以提高HTC系统的性能的问题仍然是开放的。提出了一种用于评价HTC系统中最终候选标签可靠性的路径置信度评价方法。为了考虑层次结构中嵌入的信息,使用权重因子来考虑每个级别的重要性。提出了一种自顶向下决策过程中的接受/拒绝策略,该策略通过拒绝少数百分比的样本,即,可靠性得分低的人。在路透社基准数据集(RCV 1- v2)上的实验结果证实了所提出的方法的有效性,与其他最先进的HTC方法相比。
英文摘要:
Hierarchical Text Categorization (HTC) is becoming increasingly important with the rapidly growing amount of text data available in the World Wide Web. Among the different strategies proposed to cope with HTC, the Local Classifier per Node (LCN) approach attains good performance by mirroring the underlying class hierarchy while enforcing a top-down strategy in the testing step. However, the problem of embedding hierarchical information (parent-child relationship) to improve the performance of HTC systems still remains open. A confidence evaluation method for a selected route in the hierarchy is proposed to evaluate the reliability of the final candidate labels in an HTC system. In order to take into account the information embedded in the hierarchy, weight factors are used to take into account the importance of each level. An acceptance/rejection strategy in the top-down decision making process is proposed, which improves the overall categorization accuracy by rejecting a few percentage of samples, i.e., those with low reliability score. Experimental results on the Reuters benchmark dataset (RCV1- v2) confirm the effectiveness of the proposed method, compared to other state-of-the art HTC methods.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。