FetchAid:利用深度学习增强的触摸屏引导、错误恢复机制和基于AR的搜索支持,使包裹储物柜对盲人和低视力人群更易用
FetchAid: Making Parcel Lockers More Accessible to Blind and Low Vision People With Deep-learning Enhanced Touchscreen Guidance, Error-Recovery Mechanism, and AR-based Search Support
AI总结:
FetchAid通过深度学习触摸屏引导、AR音频反馈和错误恢复机制,帮助盲人和低视力人群更高效、更低挫败地使用包裹储物柜,并在12名BLV参与者研究中验证了其有效性。
摘要:
包裹储物柜已成为日益普遍的最后一英里配送方式。然而,最近一项研究揭示了其对盲人和低视力人群(BLV)的可及性挑战。基于该研究,我们设计了FetchAid,这是一款独立的智能移动应用,通过集成计算机视觉和增强现实(AR)技术,实时协助BLV使用包裹储物柜。FetchAid首先使用深度网络检测用户指尖和包裹储物柜触摸屏上的相关按钮,引导用户出示并扫描二维码以打开目标柜门,然后通过基于AR的情境感知音频反馈引导用户安全到达柜门。此外,FetchAid提供错误恢复机制和实时反馈,使用户保持在正确操作路径上。我们在一项有12名BLV参与者参加的研究中表明,无论参与者的视力状况和先前经验如何,FetchAid都显著提高了任务完成度和效率,并减少了挫败感和总体努力。
英文摘要:
Parcel lockers have become an increasingly prevalent last-mile delivery method. Yet, a recent study revealed its accessibility challenges to blind and low-vision people (BLV). Informed by the study, we designed FetchAid, a standalone intelligent mobile app assisting BLV in using a parcel locker in real-time by integrating computer vision and augmented reality (AR) technologies. FetchAid first uses a deep network to detect the user's fingertip and relevant buttons on the touch screen of the parcel locker to guide the user to reveal and scan the QR code to open the target compartment door and then guide the user to reach the door safely with AR-based context-aware audio feedback. Moreover, FetchAid provides an error-recovery mechanism and real-time feedback to keep the user on track. We show that FetchAid substantially improved task accomplishment and efficiency, and reduced frustration and overall effort in a study with 12 BLV participants, regardless of their vision conditions and previous experience.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。