时间有效性变化预测
Temporal Validity Change Prediction
AI总结:
提出Temporal Validity Change Prediction任务及数据集,通过上下文信息检测时间有效性变化,并利用辅助任务提升基于transformer的模型性能。
摘要:
时间有效性是文本的一个重要属性,对许多下游应用很有用,如推荐系统、对话式AI或故事理解。现有的基准测试任务通常要求模型识别单个陈述的时间有效期。然而,在许多情况下,可以从可用的文本流中收集额外的上下文信息,如故事中的句子或社交媒体个人资料上的帖子。这种上下文信息可能会极大地改变陈述预期有效的时间长度。我们提出了Temporal Validity Change Prediction,这是一个自然语言处理任务,用于基准测试机器学习模型检测引发此类变化的上下文陈述的能力。我们创建了一个数据集,包含来自Twitter的时间目标陈述,并众包了样本上下文陈述。然后,我们在我们的数据集上对一组基于transformer的语言模型进行了基准测试。最后,我们尝试将时间有效期预测作为辅助任务,以提高最先进模型的性能。
英文摘要:
Temporal validity is an important property of text that is useful for many downstream applications, such as recommender systems, conversational AI, or story understanding. Existing benchmarking tasks often require models to identify the temporal validity duration of a single statement. However, in many cases, additional contextual information, such as sentences in a story or posts on a social media profile, can be collected from the available text stream. This contextual information may greatly alter the duration for which a statement is expected to be valid. We propose Temporal Validity Change Prediction, a natural language processing task benchmarking the capability of machine learning models to detect contextual statements that induce such change. We create a dataset consisting of temporal target statements sourced from Twitter and crowdsource sample context statements. We then benchmark a set of transformer-based language models on our dataset. Finally, we experiment with temporal validity duration prediction as an auxiliary task to improve the performance of the state-of-the-art model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。