从大型通用文档索引中自动检测科学政治学文本
Automatically detecting scientific political science texts from a large general document index
AI总结:
本研究提出结合硬软过滤器的方法,从BASE数据中提取政治学文章,软过滤器用微调的多语言BERT模型,准确率达0.98,方法可推广至其他学科以提升文献检索效率。
摘要:
本技术报告概述了应用于比勒费尔德学术搜索引擎(BASE)数据集合的过滤方法,用于提取政治学领域的文章。我们结合硬过滤器和软过滤器,以处理具有不同可用元数据(例如标题、摘要或关键词)的条目。硬过滤器是一种基于加权关键词的方法。软过滤器使用基于多语言BERT的分类模型,该模型经过训练以检测政治学领域的科学文章。我们使用一个由来自不同科学领域的科学文章组成的标注数据集,对这两种方法进行了评估。基于加权关键词的方法取得了0.88的最高总准确率。基于多语言BERT的分类模型使用包含14178篇科学文章摘要的数据集进行了微调,取得了0.98的最高总准确率。所提出的过滤方法可应用于过滤其他科学领域的元数据,从而改善领域相关文献的概览并提高研究效率。
英文摘要:
This technical report outlines the filtering approach applied to the collection of the Bielefeld Academic Search Engine (BASE) data to extract articles from the political science domain. We combined hard and soft filters to address entries with different available metadata, e.g. title, abstract or keywords. The hard filter is a weighted keyword-based approach. The soft filter uses a multilingual BERT-based classification model, trained to detect scientific articles from the political science domain. We evaluated both approaches using an annotated dataset, consisting of scientific articles from different scientific domains. The weighted keyword-based approach achieved the highest total accuracy of 0.88. The multilingual BERT-based classification model was fine-tuned using a dataset of 14,178 abstracts from scientific articles and reached the highest total accuracy of 0.98. The proposed filtering approach can be applied for filtering metadata from other scientific domains and therefore improve the overview of the domain-related literature and facilitate efficiency in research.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。