arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2102.03237cs.DLcs.IR
收藏

ORCID链接的标记数据用于大规模评估作者姓名消歧

ORCID-linked labeled data for evaluating author name disambiguation at scale

Jinseok Kim, Jason Owen-Smith

摘要:

我们如何评估在大书目数据上实现的消歧方法的性能?这项研究表明,开放的研究人员配置文件系统,ORCID,可以作为一个权威的来源,标签名称实例的规模。本研究通过评估Authority 2009(在MEDLINE中通过算法消除作者姓名的歧义)的消歧性能,使用300万个姓名实例(通过链接到500万个ORCID研究人员配置文件自动标记)来证明其潜力。结果表明,尽管ORCID链接的标记数据不能有效地代表Authority 2009中的名称实例的群体,但它们确实有效地捕获了Authority 2009的“高精度高召回”性能。此外,ORCID链接的标记数据可以提供有关Authority 2009的性能的细微差别的细节时,名称实例进行评估内和跨种族类别。随着ORCID继续扩展以包括更多的研究人员,通过ORCID链接的标记数据可以在表示整个消歧数据的群体方面得到改进,并定期更新。这可以使作者姓名消歧研究人员和需要大规模标记数据但缺乏用于手动标记的资源或访问其他基于链接的标记的权威来源的从业者受益。Author-tiy 2009的ORCID关联标记数据可公开获得,以供验证和重复使用。

英文摘要:

How can we evaluate the performance of a disambiguation method implemented on big bibliographic data? This study suggests that the open researcher profile system, ORCID, can be used as an authority source to label name instances at scale. This study demonstrates the potential by evaluating the disambiguation performances of Author-ity2009 (which algorithmically disambiguates author names in MEDLINE) using 3 million name instances that are automatically labeled through linkage to 5 million ORCID researcher profiles. Results show that although ORCID-linked labeled data do not effectively represent the population of name instances in Author-ity2009, they do effectively capture the 'high precision over high recall' performances of Author-ity2009. In addition, ORCID-linked labeled data can provide nuanced details about the Author-ity2009's performance when name instances are evaluated within and across ethnicity categories. As ORCID continues to be expanded to include more researchers, labeled data via ORCID-linkage can be improved in representing the population of a whole disambiguated data and updated on a regular basis. This can benefit author name disambiguation researchers and practitioners who need large-scale labeled data but lack resources for manual labeling or access to other authority sources for linkage-based labeling. The ORCID-linked labeled data for Author-tiy2009 are publicly available for validation and reuse.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑