AI 中文总结
研究盲人和低视力人群如何用智能编程创建视觉辅助工具，通过与五位用户两阶段协同设计研究，使用ProgramAT工具，揭示创建策略与挑战，为未来智能编程环境提建议，助用户创建定制视觉辅助。
AI 中文摘要
长期以来，人工智能驱动的辅助技术一直支持盲人和低视力人群完成日常任务，但这些技术通用性强，往往无法满足复杂、个性化的现场可及性需求。尽管像GitHub Copilot这样的智能编程工具有可能通过降低使用自然语言构建个人辅助技术的技术障碍来弥合这一差距，但这种创建范式的实际适用性尚不清楚。我们通过与五位精通技术的盲人和低视力用户进行两阶段纵向协同设计研究来解决这一知识差距，使用的是ProgramAT，这是一种支持基于摄像头的辅助技术的创建、迭代和测试的智能编程工具。总体而言，协同设计者创建了37种以上工具，其中一些满足了现有商业辅助技术未满足的需求，如识别优步乘车或解读手势。来自协同设计者的定性反馈和开发日志分析揭示了盲人和低视力人群的工具创建策略，以及包括模型能力限制、规范冲突和成功创建障碍等关键挑战。我们讨论了相关建议，以便为未来的智能编程环境提供适当的对话支架、社区工具共享功能，并支持专门模型和个人数据集，从而使盲人和低视力用户能够为自己创建定制视觉辅助。
英文摘要
AI-powered assistive technologies have long supported blind and low vision (BLV) people in everyday tasks, but they are general-purpose and often fall short of meeting complex, individualized, in-situ accessibility needs. Though agentic programming tools, like GitHub Copilot, have the potential to bridge this gap by lowering the technical barriers to building personal AT using natural language, the practical applicability of this creation paradigm has been unknown. We address this knowledge gap through a two-phase longitudinal co-design study with five tech-savvy BLV users using ProgramAT, an agentic programming tool that supports the creation, iteration, and testing of camera-based AT. Overall, co-designers created over 37 tools, with some addressing needs unmet by any existing commercial AT such as identifying Uber rides or interpreting hand gestures. Qualitative feedback from our co-designers and analysis of development logs surface BLV strategies for tool creation, along with key challenges including model capability limits, specification conflicts, and barriers to successful creation. We discuss recommendations to provide appropriate conversational scaffolding, community tool sharing capabilities, and support for specialized models and personal datasets for future agentic programming environments to empower BLV users to create bespoke visual assistance for themselves.
Comments24 pages, 4 figures. To be presented at The 28th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS '26)
