arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.20779cs.CL
收藏

从眼动中解码阅读目标

Decoding Reading Goals from Eye Movements

Faculty of Data and Decision Sciences, Technion - Israel Institute of Technology(以色列理工学院数据与决策科学学院);Massachusetts Institute of Technology(麻省理工学院)

Omer Shubi, Cfir Avraham Hadar, Yevgeni Berzak

AI总结:

本研究首次利用大规模眼动数据区分信息寻求与普通阅读两种目标,提出Transformer模型结合扫描路径与语言建模的集成方法,实现实时预测,并引入混合效应分析揭示任务难度关键因素。

摘要:

读者在阅读文本时可能怀有不同的目标。这些目标能否从他们在文本上的眼动中被解码出来?在这项工作中,我们首次考察了是否有可能区分两种常见的阅读目标:信息寻求和普通阅读理解。利用大规模眼动追踪数据,我们通过涵盖不同架构和数据表示策略的多种模型来处理这一任务,并进一步引入了一种新的模型集成方法。我们发现,基于Transformer的模型结合扫描路径表示和语言建模能最成功地解决这一问题,并且可以在参与者读完文本之前实时做出准确预测。我们还引入了一种基于混合效应建模的模型性能分析新方法。将该方法与丰富的文本标注相结合,揭示了导致任务难度的文本项目和参与者的关键属性,并增进了我们对两种阅读模式下眼动模式变异性的理解。

英文摘要:

Readers can have different goals with respect to the text that they are reading. Can these goals be decoded from their eye movements over the text? In this work, we examine for the first time whether it is possible to distinguish between two types of common reading goals: information seeking and ordinary reading for comprehension. Using large-scale eye tracking data, we address this task with a wide range of models that cover different architectural and data representation strategies, and further introduce a new model ensemble. We find that transformer-based models with scanpath representations coupled with language modeling solve it most successfully, and that accurate predictions can be made in real time, long before the participant finished reading the text. We further introduce a new method for model performance analysis based on mixed effect modeling. Combining this method with rich textual annotations reveals key properties of textual items and participants that contribute to the difficulty of the task, and improves our understanding of the variability in eye movement patterns across the two reading regimes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑