arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.09460cs.CLcs.LG
收藏

为什么只有Micro-F1?关系分类中测度的类加权

Why only Micro-F1? Class Weighting of Measures for Relation Classification

German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Humboldt Universität zu Berlin(柏林洪堡大学)

David Harbecke, Yuxuan Chen, Leonhard Hennig, Christoph Alt

摘要:

传统上仅使用单个度量来评估关系分类模型,例如,micro-F1、macro-F1或AUC。在这项工作中,我们分析加权方案,如微观和宏观,不平衡的数据集。我们引入一个框架加权计划,现有的计划是极端的,和两个新的中间计划。我们发现,不同的加权方案的报告结果更好地突出了一个模型的优点和缺点。

英文摘要:

Relation classification models are conventionally evaluated using only a single measure, e.g., micro-F1, macro-F1 or AUC. In this work, we analyze weighting schemes, such as micro and macro, for imbalanced datasets. We introduce a framework for weighting schemes, where existing schemes are extremes, and two new intermediate schemes. We show that reporting results of different weighting schemes better highlights strengths and weaknesses of a model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑