TYPIC:一个基于模板的论辩诊断性评论语料库
TYPIC: A Corpus of Template-Based Diagnostic Comments on Argumentation
摘要:
对学习者的论证提供反馈对于培养批判性思维技能至关重要,然而,这需要大量的时间和精力。为了减轻教师的负担,我们的目标是自动提供反馈的过程,特别是提供诊断性的评论,指出论证中固有的弱点。建议给出具体的诊断注释,以便学习者能够识别诊断而不会产生误解。然而,如何制定提供具体诊断性评论的任务并不明显。我们提出了一个制定的模板选择和插槽填充的任务,使自动评估更容易和模型的行为更容易处理。制定的关键是建立一套足以实际使用的模板。在本文中,我们定义了一个模板集应该满足的三个标准:表达性,信息性和唯一性,并验证了创建一个模板集,满足这些标准作为第一次尝试的可行性。我们将证明,这是可行的,通过一个注释的研究,将诊断意见的文本模板格式。注释研究中使用的语料库是公开的。
英文摘要:
Providing feedback on the argumentation of the learner is essential for developing critical thinking skills, however, it requires a lot of time and effort. To mitigate the overload on teachers, we aim to automate a process of providing feedback, especially giving diagnostic comments which point out the weaknesses inherent in the argumentation. It is recommended to give specific diagnostic comments so that learners can recognize the diagnosis without misinterpretation. However, it is not obvious how the task of providing specific diagnostic comments should be formulated. We present a formulation of the task as template selection and slot filling to make an automatic evaluation easier and the behavior of the model more tractable. The key to the formulation is the possibility of creating a template set that is sufficient for practical use. In this paper, we define three criteria that a template set should satisfy: expressiveness, informativeness, and uniqueness, and verify the feasibility of creating a template set that satisfies these criteria as a first trial. We will show that it is feasible through an annotation study that converts diagnostic comments given in a text to a template format. The corpus used in the annotation study is publicly available.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。