arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.11894cs.HCcs.IR
收藏

TeamTat:一个协作式文本标注工具

TeamTat: a collaborative text annotation tool

Rezarta Islamaj, Dongseop Kwon, Sun Kim, Zhiyong Lu

摘要:

人工标注的数据是开发文本挖掘和信息提取算法的关键。然而,人工注释需要大量的时间、精力和专业知识。鉴于生物医学文献的快速增长,构建能够提高速度并保持专家质量的工具至关重要。虽然现有的文本注释工具可以为领域专家提供用户友好的界面,但对图像显示、项目管理和多用户团队注释的支持有限。作为回应,我们开发了TeamTat(teamtat.org),这是一个基于Web的注释工具(本地设置可用),可以有效地管理团队注释项目。TeamTat是一种新颖的工具,用于管理多用户、多标签文档注释,反映整个生产生存周期。项目经理可以为实体和关系指定注释模式,选择注释者并匿名分发文档以防止偏见。文档输入格式可以是纯文本、PDF或BioC(本地上传或从PubMed或PMC自动检索),输出格式是带有内联注释的BioC。TeamTat显示来自全文的图形,以方便注释者。多个用户可以在他们的工作组中独立处理同一文档,团队经理可以跟踪任务完成情况。TeamTat通过注释者之间的一致性统计提供语料库质量评估,并提供一个用户友好的界面,便于注释审查和注释者之间的分歧解决,以提高语料库质量。

英文摘要:

Manually annotated data is key to developing text-mining and information-extraction algorithms. However, human annotation requires considerable time, effort and expertise. Given the rapid growth of biomedical literature, it is paramount to build tools that facilitate speed and maintain expert quality. While existing text annotation tools may provide user-friendly interfaces to domain experts, limited support is available for image display, project management, and multi-user team annotation. In response, we developed TeamTat (teamtat.org), a web-based annotation tool (local setup available), equipped to manage team annotation projects engagingly and efficiently. TeamTat is a novel tool for managing multi-user, multi-label document annotation, reflecting the entire production life cycle. Project managers can specify annotation schema for entities and relations and select annotator(s) and distribute documents anonymously to prevent bias. Document input format can be plain text, PDF or BioC, (uploaded locally or automatically retrieved from PubMed or PMC), and output format is BioC with inline annotations. TeamTat displays figures from the full text for the annotators convenience. Multiple users can work on the same document independently in their workspaces, and the team manager can track task completion. TeamTat provides corpus-quality assessment via inter-annotator agreement statistics, and a user-friendly interface convenient for annotation review and inter-annotator disagreement resolution to improve corpus quality.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑