Creating linguistic annotations requires more than just a reliable annotation scheme. Annotation can be a complex endeavour potentially involving many people, stages, and tools. This chapter outlines the process of creating end-to-end linguistic annotations, identifying specific tasks that researchers often perform. Because tool support is so central to achieving high quality, reusable annotations with low cost, the focus is on identifying capabilities that are necessary or useful for annotation tools, as well as common problems these tools present that reduce their utility. Although examples of specific tools are provided in many cases, this chapter concentrates more on abstract capabilities and problems because new tools appear continuously, while old tools disappear into disuse or disrepair. The two core capabilities tools must have are support for the chosen annotation scheme and the ability to work on the language under study. Additional capabilities are organized into three categories: those that are widely provided; those that often useful but found in only a few tools; and those that have as yet little or no available tool support.
Evaluating the Impact of LLM-Assisted Annotation in a Perspectivized Setting: the Case of FrameNet Annotation
Federal University of Juiz de Fora(弗雷德里克大学);Gothenburg University(哥德堡大学);Brazilian National Council for Scientific and Technological Development - CNPq(巴西科学与技术发展国家委员会 - CNPq)
Treebanking User-Generated Content: a UD Based Overview of Guidelines, Corpora and Unified Recommendations
Università degli Studi di Cagliari(卡利亚里大学);Università degli Studi di Torino(都灵大学);Dublin City University(都柏林城市大学);University of Stuttgart(斯图加特大学);Universitat Politècnica de València(瓦伦西亚理工大学);University of Mannheim(曼海姆大学);Leibniz-Institut für Deutsche Sprache Mannheim(曼海姆莱布尼茨德语研究所);INRIA Paris(法国国家信息与自动化研究所巴黎中心);Georgetown University(乔治城大学)
Who's Laughing Now? An Overview of Computational Humour Generation and Explanation
Department of Computer Science, The University of Sheffield, UK(谢菲尔德大学计算机科学系);Department of Computer Science, The University of Manchester, UK(曼彻斯特大学计算机科学系)
Multi-label classification for biomedical literature: an overview of the BioCreative VII LitCovid Track for COVID-19 literature topic annotations
National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health(美国国立卫生研究院国家医学图书馆国家生物技术信息中心);Children's Hospital of Philadelphia(费城儿童医院);University of Pennsylvania Perelman School of Medicine(宾夕法尼亚大学佩雷尔曼医学院);Beijing University of Technology(北京工业大学);Concordia University(康考迪亚大学);Navrachana University(纳夫拉查纳大学);Taipei Medical University(台北医学大学);Dalian University of Technology(大连理工大学);University of Ljubljana(卢布尔雅那大学);Jožef Stefan Institute(约泽夫·斯蒂芬研究所);Florida State University(佛罗里达州立大学);University of Melbourne(墨尔本大学);RMIT University(皇家墨尔本理工大学);University of Edinburgh(爱丁堡大学);University College London(伦敦大学学院);Nantes University(南特大学);Avignon University(阿维尼翁大学);Indian Institute of Technology Delhi(印度理工学院德里分校);Opscidia(Opscidia公司);The Hong Kong Polytechnic University(香港理工大学);Heidelberg University(海德堡大学);Bosch Center for Artificial Intelligence(博世人工智能中心);Universidad de Jaén(哈恩大学);TCS Research(塔塔咨询服务公司研究部)
Are You There God? Lightweight Narrative Annotation of Christian Fiction with LMs
Department of Computer Science, Cornell University(计算机科学系,康奈尔大学);Department of Sociology, Cornell University(社会学系,康奈尔大学);Department of Information Science, Cornell University(信息科学系,康奈尔大学)
Global Contentious Politics Database (GLOCON) Annotation Manuals
数据库的创建利用了自动化的文本处理工具,这些工具检测新闻文章是否包含抗议事件,在文章中定位抗议信息,并提取关于检测到的抗议事件的信息片段。培训和测试自动化工具的基础是GLOCON Gold Standard Corpus(GSC),其中包含来自每个重点国家的多个来源的新闻文章。GSC中的文章由熟练的注释者在分类和提取任务中手动编码,具有自动化工具开发所需的最高准确性和一致性。为了确保这些,本文档中的注释手册列出了注释者对新闻文章进行编码的规则。注释者在所有注释任务中始终参考手册,并应用其中包含的规则。注释手册的内容建立在其他著名注释手册(如ACE,CAMEO和TimeML)中规定的语言注释的一般原则和标准之上。然而,这些原则已被改编或修改,以适应社会科学的概念和变量中使用的EMW项目。该手册是在长期的试错过程中形成的,伴随着GSC的注释。它现在的形状在很大程度上归功于高度专业化的注释者团队的细致工作和宝贵的反馈,他们的勤奋和专业知识大大提高了语料库的质量。
Creating a morphological and syntactic tagged corpus for the Uzbek language
Urgench State University(乌尔根奇国立大学);Urgench Branch of Tashkent university of Information Technologies Named After Muhammad al-Khwarizmi(穆罕默德·花剌子米塔什干信息技术大学乌尔根奇分校)