SV-Ident 2022社会科学出版物中调查变量识别共享任务概述
Overview of the SV-Ident 2022 Shared Task on Survey Variable Identification in Social Science Publications
摘要:
在本文中,我们概述了SV-Ident共享任务,作为COLING 2022第三届学术文档处理研讨会(SDP)的一部分。在共同的任务中,参与者被提供了一个句子和一个变量的词汇表,并要求确定哪些变量,如果有的话,在全文学术文献的个别句子中提到。两个团队共向共享任务排行榜提交了9份报告。虽然没有团队改进基线系统,但我们仍然从他们的提交中获得见解。此外,我们还提供了详细的评估。我们共享任务的数据和基线可在https://github.com/vadis-project/sv-ident上免费获得
英文摘要:
In this paper, we provide an overview of the SV-Ident shared task as part of the 3rd Workshop on Scholarly Document Processing (SDP) at COLING 2022. In the shared task, participants were provided with a sentence and a vocabulary of variables, and asked to identify which variables, if any, are mentioned in individual sentences from scholarly documents in full text. Two teams made a total of 9 submissions to the shared task leaderboard. While none of the teams improve on the baseline systems, we still draw insights from their submissions. Furthermore, we provide a detailed evaluation. Data and baselines for our shared task are freely available at https://github.com/vadis-project/sv-ident
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。