arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.01532cs.HCcs.CL
收藏

使用大语言模型加速重度运动障碍用户的通信

Using Large Language Models to Accelerate Communication for Users with Severe Motor Impairments

Google(谷歌);Team Gleason Foundation(格里森团队基金会);Harvard University(哈佛大学)
Shanqing Cai, Subhashini Venugopalan, Katie Seaver, Xiang Xiao, Katrin Tomanek, Sri Jalasutram, Meredith Ringel Morris, Shaun Kane, Ajit Narayanan, Robert L. Ma… 展开作者

Shanqing Cai, Subhashini Venugopalan, Katie Seaver, Xiang Xiao, Katrin Tomanek, Sri Jalasutram, Meredith Ringel Morris, Shaun Kane, Ajit Narayanan, Robert L. MacDonald, Emily Kornman, Daniel Vance, Blair Casey, Steve M. Gleason, Philip Q. Nelson, Michael P. Brenner

AI总结:

本文提出SpeakFaster系统,结合大语言模型与缩写输入界面,在模拟和真实ALS眼动用户测试中显著减少运动动作并提升文本输入速率29-60%,为运动障碍用户加速通信开辟了新方向。

摘要:

为患有严重运动障碍的个人寻找加速文本输入的方法一直是一个长期的研究领域。缩小眼动追踪键盘等增强和替代通信(AAC)设备的速度差距,对于改善此类个人的生活质量非常重要。自然语言神经网络的最新进展为重新思考策略和用户界面以增强AAC用户的文本输入提供了新的机会。在本文中,我们提出了SpeakFaster,它由大语言模型(LLMs)和一个共同设计的用户界面组成,用于以高度缩写的形式进行文本输入,在离线模拟中比传统预测键盘节省了57%以上的运动动作。一项由19名非AAC参与者在移动设备上手动打字的试点研究表明,运动节省的收益与离线模拟一致,同时对整体打字速度的影响相对较小。对两名患有肌萎缩侧索硬化症(ALS)的眼动打字用户进行的实验室和现场测试表明,文本输入速率比传统基线快29-60%,这得益于通过上下文感知LLMs的短语和单词预测所实现的昂贵击键的显著节省。这些发现为进一步探索面向运动障碍用户的大幅加速文本通信奠定了坚实的基础,并展示了将LLMs应用于基于文本的用户界面的方向。

英文摘要:

Finding ways to accelerate text input for individuals with profound motor impairments has been a long-standing area of research. Closing the speed gap for augmentative and alternative communication (AAC) devices such as eye-tracking keyboards is important for improving the quality of life for such individuals. Recent advances in neural networks of natural language pose new opportunities for re-thinking strategies and user interfaces for enhanced text-entry for AAC users. In this paper, we present SpeakFaster, consisting of large language models (LLMs) and a co-designed user interface for text entry in a highly-abbreviated form, allowing saving 57% more motor actions than traditional predictive keyboards in offline simulation. A pilot study with 19 non-AAC participants typing on a mobile device by hand demonstrated gains in motor savings in line with the offline simulation, while introducing relatively small effects on overall typing speed. Lab and field testing on two eye-gaze typing users with amyotrophic lateral sclerosis (ALS) demonstrated text-entry rates 29-60% faster than traditional baselines, due to significant saving of expensive keystrokes achieved through phrase and word predictions from context-aware LLMs. These findings provide a strong foundation for further exploration of substantially-accelerated text communication for motor-impaired users and demonstrate a direction for applying LLMs to text-based user interfaces.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑