为什么只有Micro-F1?关系分类中测度的类加权
Why only Micro-F1? Class Weighting of Measures for Relation Classification
摘要:
传统上仅使用单个度量来评估关系分类模型,例如,micro-F1、macro-F1或AUC。在这项工作中,我们分析加权方案,如微观和宏观,不平衡的数据集。我们引入一个框架加权计划,现有的计划是极端的,和两个新的中间计划。我们发现,不同的加权方案的报告结果更好地突出了一个模型的优点和缺点。
英文摘要:
Relation classification models are conventionally evaluated using only a single measure, e.g., micro-F1, macro-F1 or AUC. In this work, we analyze weighting schemes, such as micro and macro, for imbalanced datasets. We introduce a framework for weighting schemes, where existing schemes are extremes, and two new intermediate schemes. We show that reporting results of different weighting schemes better highlights strengths and weaknesses of a model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。