arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.18229cs.CL
收藏

回眸修订:阅读中的回视与跳读作为增量处理中修订策略的认知信号

Revising with a Backward Glance: Regressions and Skips during Reading as Cognitive Signals for Revision Policies in Incremental Processing

University of Potsdam(波茨坦大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI))

Brielen Madureira, Pelin Çelikkol, David Schlangen

AI总结:

本文研究利用人类阅读眼动中的回视与跳读信号来训练增量序列标注模型的修订策略,并通过广义混合效应模型验证其对BiLSTM和Transformer模型在多语言场景下的预测有效性。

摘要:

在自然语言处理中,增量处理器根据语言输入的到达前缀逐步产生输出。某些词元会触发修订,导致对输出假设进行编辑,但人们对模型为何在特定时刻进行修订知之甚少。能够检测出应当发生修订的时间步的策略可以提高效率。然而,获取合适的信号来训练修订策略仍是一个开放问题,因为这种信号在数据集中并非自然可得。在本工作中,我们研究了人类阅读眼动数据中的回视与跳读作为信号来指导增量序列标注中的修订策略的适用性。通过使用广义混合效应模型,我们发现人类回视与跳读的概率有可能作为BiLSTM和Transformer模型中修订的有用预测因子,并且在多种语言上结果一致。

英文摘要:

In NLP, incremental processors produce output in instalments, based on incoming prefixes of the linguistic input. Some tokens trigger revisions, causing edits to the output hypothesis, but little is known about why models revise when they revise. A policy that detects the time steps where revisions should happen can improve efficiency. Still, retrieving a suitable signal to train a revision policy is an open problem, since it is not naturally available in datasets. In this work, we investigate the appropriateness of regressions and skips in human reading eye-tracking data as signals to inform revision policies in incremental sequence labelling. Using generalised mixed-effects models, we find that the probability of regressions and skips by humans can potentially serve as useful predictors for revisions in BiLSTMs and Transformer models, with consistent results for various languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑