arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2006.03679cs.CL
收藏

布拉格省树库-合并1.0

Prague Dependency Treebank -- Consolidated 1.0

Charles University(查理大学)

Jan Hajič, Eduard Bejček, Jaroslava Hlaváčová, Marie Mikulová, Milan Straka, Jan Štěpánek, Barbora Štěpánková

摘要:

我们提出了一个丰富的注释和体裁多样化的语言资源,布拉格省树库统一1.0(PDT-C 1.0),其目的是-因为它一直是布拉格省树库的家庭的情况下-既作为训练数据的各种类型的NLP任务,以及语言为导向的研究。PDT-C 1.0包含四个不同的捷克语数据集,使用标准PDT方案统一注释(尽管并非所有内容都是手动注释的,正如我们在这里详细描述的那样)。这些文本来自不同的来源:每日报纸文章、捷克语翻译的《华尔街日报》、转录的对话和少量用户生成的、简短的、通常非标准的语言片段。总的来说,树库包含大约180,000个句子及其形态,表面和深层句法注释。文本和注释的多样性应该很好地服务于NLP应用,并且它是语言研究的宝贵资源,包括对不同体裁文本的比较研究。语料库是公开和免费提供的。

英文摘要:

We present a richly annotated and genre-diversified language resource, the Prague Dependency Treebank-Consolidated 1.0 (PDT-C 1.0), the purpose of which is - as it always been the case for the family of the Prague Dependency Treebanks - to serve both as a training data for various types of NLP tasks as well as for linguistically-oriented research. PDT-C 1.0 contains four different datasets of Czech, uniformly annotated using the standard PDT scheme (albeit not everything is annotated manually, as we describe in detail here). The texts come from different sources: daily newspaper articles, Czech translation of the Wall Street Journal, transcribed dialogs and a small amount of user-generated, short, often non-standard language segments typed into a web translator. Altogether, the treebank contains around 180,000 sentences with their morphological, surface and deep syntactic annotation. The diversity of the texts and annotations should serve well the NLP applications as well as it is an invaluable resource for linguistic research, including comparative studies regarding texts of different genres. The corpus is publicly and freely available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑