发表机构
University of Waterloo; Southern University of Science and Technology; Hong Kong University of Science and Technology (Guangzhou); National Research Council(滑铁卢大学; 南方科技大学; 香港科技大学(广州); 国家研究委员会)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
EMooly是一款结合AR与生成式AI的平板游戏,通过照护者参与和个性化活动,显著提升自闭症儿童的情绪识别能力。
AI 中文摘要
自闭症谱系障碍(ASD)儿童存在社交情绪缺陷,导致他们在识别情绪以及理解和回应社交互动方面存在困难。本研究提出了EMooly,一款平板电脑游戏,它积极吸纳照护者参与,并利用增强现实(AR)和生成式AI(GenAI)来增强自闭症儿童的社交情绪学习。通过与五位领域专家一年的协作努力,我们开发了EMooly,通过个性化社交故事、互动有趣的活动以及增强的照护者参与来吸引儿童,重点关注情绪理解和面部表情识别。与基线相比,一项针对24名自闭症儿童及其照护者的对照研究表明,EMooly显著提高了儿童的情绪识别技能,其新颖功能也受到青睐和赞赏。EMooly展示了AI和AR通过即时个性化和参与来增强自闭症儿童社交情绪发展的潜力,并强调了照护者参与对实现最佳学习成果的重要性。
英文摘要
Children with autism spectrum disorder (ASD) have social-emotional deficits that lead to difficulties in recognizing emotions as well as understanding and responding to social interactions. This study presents EMooly, a tablet game that actively involves caregivers and leverages augmented reality (AR) and generative AI (GenAI) to enhance social-emotional learning for autistic children. Through a year of collaborative effort with five domain experts, we developed EMooly that engages children through personalized social stories, interactive and fun activities, and enhanced caregiver participation, focusing on emotion understanding and facial expression recognition. Compared with a baseline, a controlled study with 24 autistic children and their caregivers showed EMooly significantly improved children's emotion recognition skills and its novel features were preferred and appreciated. EMooly demonstrates the potential of AI and AR in enhancing social-emotional development for autistic children via prompt personalizing and engagement, and highlights the importance of caregiver involvement for optimal learning outcomes.
Comments38 pages. Published in Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT), Vol. 8, No. 4, Article 203 (December 2024)
Journal refProc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 4, Article 203 (December 2024)
DOI:10.1145/3699738