ProgramAlly:通过多模态终端用户编程创建自定义视觉访问程序
ProgramAlly: Creating Custom Visual Access Programs via Multi-Modal End-User Programming
AI总结:
本文提出ProgramAlly系统,利用积木编程、自然语言和示例编程三种方式,让盲人用户自定义视觉访问程序,并通过12名盲人用户研究验证了其可行性与价值。
摘要:
现有的视觉辅助技术是为简单和常见的用例而构建的,并且盲人几乎没有途径来定制其功能。借鉴先前关于DIY辅助技术的工作,本文研究了终端用户编程作为一种手段,使用户能够创建和定制视觉访问程序以满足其独特需求。我们介绍了ProgramAlly,一个用于创建视觉信息自定义过滤器的系统,例如“在公交车上找到数字”,该系统利用三种终端用户编程方法:积木式编程、自然语言和示例编程。为了实现ProgramAlly,我们基于盲人遇到的场景设计了一种视觉过滤任务的表示,并集成了一组设备和云模型来生成和运行这些程序。在对12名盲人成年人进行的用户研究中,我们发现参与者根据任务偏好不同的编程模式,并设想使用视觉访问程序来解决现有应用难以处理的独特可访问性挑战。通过ProgramAlly,我们展示了盲人终端用户如何创建视觉访问程序来定制和控制其体验的探索。
英文摘要:
Existing visual assistive technologies are built for simple and common use cases, and have few avenues for blind people to customize their functionalities. Drawing from prior work on DIY assistive technology, this paper investigates end-user programming as a means for users to create and customize visual access programs to meet their unique needs. We introduce ProgramAlly, a system for creating custom filters for visual information, e.g., 'find NUMBER on BUS', leveraging three end-user programming approaches: block programming, natural language, and programming by example. To implement ProgramAlly, we designed a representation of visual filtering tasks based on scenarios encountered by blind people, and integrated a set of on-device and cloud models for generating and running these programs. In user studies with 12 blind adults, we found that participants preferred different programming modalities depending on the task, and envisioned using visual access programs to address unique accessibility challenges that are otherwise difficult with existing applications. Through ProgramAlly, we present an exploration of how blind end-users can create visual access programs to customize and control their experiences.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。