视障人士以非视觉方式感知环境，常使用人工智能辅助工具获取视觉信息的文本描述。近期基于大视觉语言模型的人工智能工具（如Be My AI）更能理解用户的自然语言询问，并以可听文本描述场景；但目前这些工具对视障用户的有用程度仍缺乏研究。本文旨在填补这一空白。我们对14名视障用户开展的研究显示，他们正在有机地适配这些工具——这些工具不仅能促进家庭、空间和社交场景下的复杂互动，还可作为用户认知的延伸，仿佛认知分布在视觉信息之中。我们还发现，尽管当前这些工具不具备目标导向性，但用户会适应这一局限，并乐于将工具的能力用于更广泛的场景。这些发现为我们设计更具目标导向性、实时处理能力且可靠的人工智能辅助技术提供了思路。
英文摘要：
People with visual impairments perceive their environment non-visually and often use AI-powered assistive tools to obtain textual descriptions of visual information. Recent large vision-language model-based AI-powered tools like Be My AI are more capable of understanding users' inquiries in natural language and describing the scene in audible text; however, the extent to which these tools are useful to visually impaired users is currently understudied. This paper aims to fill this gap. Our study with 14 visually impaired users reveals that they are adapting these tools organically -- not only can these tools facilitate complex interactions in household, spatial, and social contexts, but they also act as an extension of users' cognition, as if the cognition were distributed in the visual information. We also found that although the tools are currently not goal-oriented, users accommodate this limitation and embrace the tools' capabilities for broader use. These findings enable us to envision design implications for creating more goal-oriented, real-time processing, and reliable AI-powered assistive technology.
Beyond Reactive Assistance: PV-Care Using Low-Density EEG and AI to Provide Proactive, Context-Aware Help for MCI
Shanghai High School International Division（上海中学国际部）；Elmore Family School of Electrical and Computer Engineering, Purdue University（普渡大学埃尔莫电气与计算机工程学院）；Apple Inc.（苹果公司）
An AI-Driven Multimodal Smart Home Platform for Continuous Monitoring and Assistance in Post-Stroke Motor Impairment
University of Cambridge（剑桥大学）；Beihang University（北京航空航天大学）；KAUST（阿卜杜拉国王科技大学）；Beijing New Guoxin Software Evaluation Technology Co ltd（北京新国信软件评测技术有限公司）；Beijing Tsinghua Changgung Hospital, Tsinghua University（清华大学北京清华长庚医院）；University College London（伦敦大学学院）；Beijing Tongren Hospital, Capital Medical University（首都医科大学附属北京同仁医院）
OpenGuide: Assistive Object Retrieval in Indoor Spaces for Individuals with Visual Impairments
Department of Civil and Environmental Engineering, University of Michigan（密歇根大学土木与环境工程系）；College of Literature, Science, and the Arts, University of Michigan（密歇根大学文学、科学与艺术学院）
Adaptive Control in Assistive Application -- A Study Evaluating Shared Control by Users with Limited Upper Limb Mobility
German Research Center for Artificial Intelligence (DFKI)（德国人工智能研究中心）；TU Dortmund University（多特蒙德工业大学）；University of Duisburg-Essen（杜伊斯堡-埃森大学）；Frankfurt University of Applied Sciences（法兰克福应用科学大学）
Enhanced Accessibility for Mobile Indoor Navigation
Fraunhofer Institute for Open Communication Systems (FOKUS)（弗劳恩霍夫开放通信系统研究所）；Daimler Center for Automotive IT Innovations (DCAITI)（戴姆勒汽车IT创新中心）；Hochschule für Technik und Wirtschaft University of Applied Sciences Berlin（柏林应用技术大学）
Legible Shared Autonomy: Implicit Communication of Robot Belief through Motion
Department of Automation, University of Science and Technology of China（自动化系，中国科学技术大学）；Department of Automation, Hefei University of Technology（自动化系，合肥工业大学）；National Key Laboratory of Autonomous Intelligent Unmanned Systems（自主智能无人系统国家重点实验室）
