arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.01113cs.CL
收藏

时间表达式理解的语言模型探索

Probing Language Models for Understanding of Temporal Expressions

University of Washington(华盛顿大学)

Shivin Thukral, Kunal Kukreja, Christian Kavouras

摘要:

我们提出了三个自然语言推理(NLI)的挑战集,可以评估NLI模型的时间表达式的理解。更具体地说,我们探测这些模型的三个时间属性:(a)时间点之间的顺序,(b)两个时间点之间的持续时间,(c)在不同的单位指定的时间的大小之间的关系。我们发现,虽然大语言模型微调MNLI有一些基本的时间点之间的顺序的看法,在大,这些模型没有一个彻底的时间表达式之间的关系的理解。

英文摘要:

We present three Natural Language Inference (NLI) challenge sets that can evaluate NLI models on their understanding of temporal expressions. More specifically, we probe these models for three temporal properties: (a) the order between points in time, (b) the duration between two points in time, (c) the relation between the magnitude of times specified in different units. We find that although large language models fine-tuned on MNLI have some basic perception of the order between points in time, at large, these models do not have a thorough understanding of the relation between temporal expressions.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑