arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2207.01674cs.IR
收藏

GazBy:基于注视的BERT模型在神经信息检索中的应用

GazBy: Gaze-Based BERT Model to Incorporate Human Attention in Neural Information Retrieval

Sibo Dong, Justin Goldstein, Grace Hui Yang

摘要:

本文主要研究人类的注视信号是否可以用来提高最先进的搜索引擎的性能,以及如何将这种由人类注意力标记的新输入信号纳入现有的神经检索模型。在本文中,我们提出了GazBy(基于{\bf Gaz} e的{ \bf B}ert模型,用于文档相关性{ \bf y}),一个轻量级的联合模型,将人类凝视固定估计集成到Transformer模型中以预测文档相关性,将有关认知处理的更多细微差别的信息纳入信息检索(IR)。我们在文本检索会议(TREC)深度学习(DL)2019和2020轨道上评估了我们的模型。我们的实验显示了令人鼓舞的结果,并说明了使用人类凝视来帮助基于transformer的神经检索器的有效和无效的切入点。随着虚拟现实(VR)和增强现实(AR)的兴起,人类的凝视数据将变得更加可用。我们希望这项工作可以作为探索在现代神经搜索引擎中使用凝视信号的第一步。

英文摘要:

This paper is interested in investigating whether human gaze signals can be leveraged to improve state-of-the-art search engine performance and how to incorporate this new input signal marked by human attention into existing neural retrieval models. In this paper, we propose GazBy ({\bf Gaz}e-based {\bf B}ert model for document relevanc{\bf y}), a light-weight joint model that integrates human gaze fixation estimation into transformer models to predict document relevance, incorporating more nuanced information about cognitive processing into information retrieval (IR). We evaluate our model on the Text Retrieval Conference (TREC) Deep Learning (DL) 2019 and 2020 Tracks. Our experiments show encouraging results and illustrate the effective and ineffective entry points for using human gaze to help with transformer-based neural retrievers. With the rise of virtual reality (VR) and augmented reality (AR), human gaze data will become more available. We hope this work serves as a first step exploring using gaze signals in modern neural search engines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑