arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/9901005cs.CL
收藏

时间参考解析的实证方法(期刊版)

An Empirical Approach to Temporal Reference Resolution (journal version)

Janyce Wiebe, Thomas P. O'Hara, Thorsten Ohrstrom-Sandgren, Kenneth K. McKeever

摘要:

在日常生活中,人们协商约会时间的日程安排对话很常见。本文报告了一个深入的实证调查的结果,解决明确的时间参考调度对话。这项工作有四个阶段:数据注释和评估,模型开发,系统实施和评估,模型评估和分析。该系统和模型主要是在一组数据上开发的,然后应用于更复杂的数据集,以评估模型对正在执行的任务的通用性。许多不同类型的经验方法被应用于查明该方法的优点和缺点。详细的注释指令的开发和intercoder的可靠性研究进行,表明天真的注释可以可靠地执行有针对性的注释。一个全自动的系统已经开发和评价看不见的测试数据,两个数据集上的良好结果。我们采用了一个纯粹的实现最近为基础的焦点模型,以准确地确定它是什么时候,是不是足够的任务正在处理。除了系统的结果,模型本身的深入评价,详细的手动注释的基础上。结果是,很少发生的错误,特别是由于使用的模型的焦点,和一组在模型中定义的照应关系是低的歧义两个数据集。

英文摘要:

Scheduling dialogs, during which people negotiate the times of appointments, are common in everyday life. This paper reports the results of an in-depth empirical investigation of resolving explicit temporal references in scheduling dialogs. There are four phases of this work: data annotation and evaluation, model development, system implementation and evaluation, and model evaluation and analysis. The system and model were developed primarily on one set of data, and then applied later to a much more complex data set, to assess the generalizability of the model for the task being performed. Many different types of empirical methods are applied to pinpoint the strengths and weaknesses of the approach. Detailed annotation instructions were developed and an intercoder reliability study was performed, showing that naive annotators can reliably perform the targeted annotations. A fully automatic system has been developed and evaluated on unseen test data, with good results on both data sets. We adopt a pure realization of a recency-based focus model to identify precisely when it is and is not adequate for the task being addressed. In addition to system results, an in-depth evaluation of the model itself is presented, based on detailed manual annotations. The results are that few errors occur specifically due to the model of focus being used, and the set of anaphoric relations defined in the model are low in ambiguity for both data sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑