arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2104.00870cs.HC
收藏

GAVIN:基于语音的凝视辅助隐式笔记

GAVIN: Gaze-Assisted Voice-Based Implicit Note-taking

Anam Ahmad Khan, Joshua Newn, Ryan Kelly, Namrata Srivastava, James Bailey, Eduardo Velloso

摘要:

注释是人们在与数字文本交互时经常采用的一种有效的阅读策略。它涉及突出显示文本片段并对其进行注释。在桌面环境中阅读时进行注释被认为是微不足道的,但是在人们手持设备阅读的移动环境中,在移动显示器上突出显示和键入笔记的任务是具有挑战性的。在本文中,我们介绍了GAVIN,一个凝视辅助语音笔记应用程序,它使读者能够无缝地采取语音笔记的数字文档隐式锚定到文本段落。我们首先进行了一项情境调查,重点是参与者对数字文档的笔记做法。利用这些发现,我们提出了一种方法,利用眼动跟踪和机器学习技术来注释语音笔记与参考文本段落。为了评估我们的方法,我们招募了32名参与者进行语音笔记。接下来,我们在收集的数据上训练了一个分类器,以预测参与者做语音笔记的文本段落。最后,我们使用分类器建立GAVIN,并进行了用户研究,以证明系统的可行性。这项研究证明了使用凝视作为语音注释隐式锚定资源的可行性,从而能够设计允许用户以最小的努力和高准确性记录语音注释的系统。

英文摘要:

Annotation is an effective reading strategy people often undertake while interacting with digital text. It involves highlighting pieces of text and making notes about them. Annotating while reading in a desktop environment is considered trivial but, in a mobile setting where people read while hand-holding devices, the task of highlighting and typing notes on a mobile display is challenging. In this paper, we introduce GAVIN, a gaze-assisted voice note-taking application, which enables readers to seamlessly take voice notes on digital documents by implicitly anchoring them to text passages. We first conducted a contextual enquiry focusing on participants' note-taking practices on digital documents. Using these findings, we propose a method which leverages eye-tracking and machine learning techniques to annotate voice notes with reference text passages. To evaluate our approach, we recruited 32 participants performing voice note-taking. Following, we trained a classifier on the data collected to predict text passage where participants made voice notes. Lastly, we employed the classifier to built GAVIN and conducted a user study to demonstrate the feasibility of the system. This research demonstrates the feasibility of using gaze as a resource for implicit anchoring of voice notes, enabling the design of systems that allow users to record voice notes with minimal effort and high accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑