AI 中文总结
针对AR/MR阅读中视觉显示不适用于需感知现实环境的场景,提出Switched Reading交互框架,实现两项关键技术,经用户研究验证其可提升阅读表现与体验,还开发了行走阅读应用并获设计启示。
AI 中文摘要
如今,增强/混合现实(AR/MR)可穿戴眼镜支持在任意地点进行信息交互,但当需要感知现实世界环境时,视觉显示可能并不适用。我们提出了Switched Reading,这一用于在AR/MR中阅读文本的新型交互框架,支持根据需要在视觉与听觉模态间切换。具体而言,我们在该框架中探索了两项关键交互技术:(1)基于注视的语音播放,(2)感知对应关系的过渡效果。我们通过参数调优用户测试在一款MR头显上实现了这些技术。随后,我们开展了一项用户研究(N=16),在虚拟现实环境中模拟模态切换场景,以探究这两项技术对阅读表现及整体用户体验的影响。结果显示,结合两项技术的条件在四种条件中最受偏好。此外,我们发现,基于注视的语音播放可减少模态切换时的注视偏移,并相比使用滚动位置的基准条件提升了阅读速度。最后,我们实现了一款用于行走时阅读的Switched Reading应用,并收集了用户反馈,为实际应用提供了进一步的设计启示。
英文摘要
Augmented/mixed reality (AR/MR) wearable glasses now permit information interaction anywhere, but visual displays can be inappropriate when real-world awareness is essential. We propose Switched Reading, a novel interaction framework for reading text in AR/MR that supports switching between visual and auditory modalities as needed. Specifically, we explore two key interaction techniques within this framework: (1) gaze-based voice playback and (2) a correspondence-aware transition effect. We implemented them on an MR headset through a parameter-tuning user test. Next, we conducted a user study (N=16) to investigate the impact of the two techniques on reading performance and overall user experience with simulated modality switching in virtual reality. The results show that the condition combining both techniques was the most preferred among four conditions. Moreover, we found that the gaze-based voice playback reduced gaze offsets when switching modalities and improved reading speed over the baseline condition using scroll position. Finally, we implemented a Switched Reading application for reading while walking and collected user feedback, yielding further design implications for practical use.