arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1403.0801cs.CL
收藏

得到正确的答案仅仅是选择正确的单词吗?句法信息特征在简答题评分中的作用

Is getting the right answer just about choosing the right words? The role of syntactically-informed features in short answer scoring

Educational Testing Service(教育考试服务中心);Nuance Communications(Nuance通信公司);Tuebingen University(图宾根大学);Yahoo! Labs(雅虎研究院)
Derrick Higgins, Chris Brew, Michael Heilman, Ramon Ziai, Lei Chen, Aoife Cahill, Michael Flor, Nitin Madnani, Joel Tetreault, Daniel Blanchard, Diane Napolitan… 展开作者

Derrick Higgins, Chris Brew, Michael Heilman, Ramon Ziai, Lei Chen, Aoife Cahill, Michael Flor, Nitin Madnani, Joel Tetreault, Daniel Blanchard, Diane Napolitano, Chong Min Lee, John Blackmore

摘要:

教育领域的发展激发了人们对自动评分简答问题的更大兴趣。最近关于这个主题的一个共享任务揭示了应用于这个问题的建模方法的根本分歧,表现最好的系统分为采用知识工程方法的系统和几乎完全利用词汇信息(而不是更高级别的句法信息)为给定响应分配分数的系统。本文旨在向NLP社区介绍目前可用于简答题评分的最大语料库,概述使用此数据的共享任务中使用的方法,并探索更多句法信息功能在多大程度上有助于简答题评分任务,以避免知识工程方法的特定问题手动工作。

英文摘要:

Developments in the educational landscape have spurred greater interest in the problem of automatically scoring short answer questions. A recent shared task on this topic revealed a fundamental divide in the modeling approaches that have been applied to this problem, with the best-performing systems split between those that employ a knowledge engineering approach and those that almost solely leverage lexical information (as opposed to higher-level syntactic information) in assigning a score to a given response. This paper aims to introduce the NLP community to the largest corpus currently available for short-answer scoring, provide an overview of methods used in the shared task using this data, and explore the extent to which more syntactically-informed features can contribute to the short answer scoring task in a way that avoids the question-specific manual effort of the knowledge engineering approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑