arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.28246cs.SE
收藏

为有(运动)障碍儿童的语音控制Scratch

Voice-Controlled Scratch for Children with (Motor) Disabilities

University of Passau(帕绍大学);Technical University of Darmstadt(达姆施塔特工业大学)

Elias Goller, Gordon Fraser, Isabella Graßl

AI总结:

本文提出MeowCrophone,通过语音控制实现Scratch编程环境的无障碍编辑,采用多模态语音界面提升残障儿童的交互体验。

摘要:

基于Scratch的块状编程环境在计算机教育中广泛应用,但基于鼠标拖放的界面对残障用户构成挑战。尽管先前工作提供了支持视障儿童的解决方案,但这些方案主要关注内容的可感知性,未解决运动障碍用户面临的物理交互障碍。为弥合这一差距,我们引入MeowCrophone,通过语音控制实现Scratch代码的编辑。MeowCrophone支持点击元素、放置积木和导航工作区,通过数字叠加和标签阅读的多模态语音用户界面,完全绕过物理输入。由于课堂上不完美的语音识别普遍存在,MeowCrophone采用多阶段匹配管道,结合正则表达式、语音匹配和自定义语法规则。评估显示,尽管自由语音识别系统仅达到46.4%的基准成功率,MeowCrophone的管道将结果提升至82.8%,简单命令的准确率达到96.9%。这证明了稳健的语音控制可以使得Scratch对视觉辅助不足的用户可访问。

英文摘要:

Block-based programming environments like Scratch have become widely adopted in Computer Science Education, but the mouse-based drag-and-drop interface can challenge users with disabilities. While prior work has provided solutions supporting children with visual impairment, these solutions tend to focus on making content perceivable and do not address the physical interaction barriers faced by users with motor disabilities. To bridge this gap, we introduce MeowCrophone, an approach that uses voice control to allow editing code in Scratch. MeowCrophone supports clicking elements, placing blocks, and navigating the workspace via a multi-modal voice user interface that uses numerical overlays and label reading to bypass physical input entirely. As imperfect speech recognition is common in classrooms and for children with dysarthria, MeowCrophone employs a multi-stage matching pipeline using regular expressions, phonetic matching, and a custom grammar. Evaluation shows that while free speech recognition systems achieved a baseline success rate of only 46.4%, MeowCrophone's pipeline improved results to 82.8% overall, with simple commands reaching 96.9% accuracy. This demonstrates that robust voice control can make Scratch accessible to users for whom visual aids are insufficient.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑