对话式触觉数据接口:使用可刷新触觉显示器和对话式人工智能与盲人用户共同设计无障碍数据体验
Conversational Tactile Data Interfaces: Co-Designing Accessible Data Experiences with Blind Users Using Refreshable Tactile Displays and Conversational AI
浏览论文内容
中文总结 AI 辅助
研究针对盲人或视力低下者数据可视化问题,通过与盲人共同设计师协同设计,创建结合可刷新触觉显示器与对话代理的CTDI(Graphy系统),贡献设计知识与建议,得出分层展示等关键发现。
中文摘要 AI 辅助
将可刷新触觉显示器(RTD)与对话式人工智能相结合,为盲人或视力低下者提供了一种很有前景的无障碍数据可视化方法。然而,如何整合这些模式以支持无障碍数据体验仍是一个悬而未决的问题。我们通过与三位盲人共同设计师的协同设计过程来解决这一问题。基于之前的奥兹巫师研究,我们创建了一个对话式触觉数据接口(CTDI),它将RTD与基于大语言模型的对话代理相结合,并在八个月内通过四个研讨会进行了完善。除了最终的Graphy系统,我们还贡献了CTDI的设计知识和建议。共同设计师将触摸作为对数据形状、趋势和关系进行空间理解的主要感知通道,将代理用于触摸无法解决的问题(如计算和分析),并使用RTD上的图表来验证代理的回答。主要发现包括:通过渐进式交互层搭建图表探索的分层展示;区分用户和代理发起的触觉反馈的反馈语法;以及选择、确认、询问、验证的顺序交互模式,其中每一步都基于上一步。
英文摘要
Combining refreshable tactile displays (RTDs) with conversational AI offers a promising approach to accessible data visualization for people who are blind or have low vision (BLV). However, it remains an open question how these modalities should be integrated to support accessible data experiences. We address this through a co-design process with three BLV co-designers. Building on our prior Wizard-of-Oz study, we created a conversational tactile data interface (CTDI) that combines an RTD with an LLM-powered conversational agent, refined through four workshops over eight months. In addition to the resulting system, Graphy, we contribute design knowledge and recommendations for CTDIs. Co-designers used touch as the primary sensemaking channel for spatial understanding of the data's shape, trends, and relationships, reserved the agent for what touch could not resolve (e.g., calculation and analysis), and used the chart on the RTD to verify the agent's responses. Key findings include: a layered presentation that scaffolds chart exploration through progressive, interactive layers; a feedback grammar that distinguishes user- and agent-initiated tactile feedback; and a sequential interaction pattern -- select, confirm, ask, verify -- where each step grounds the last.