AI 中文总结
研究探索基于生成式人工智能的VR沟通训练对自闭症个体的作用,通过9名受训者和7名教练参与的三种模式实验发现,C+O+G模式更受青睐,可用性和工作量相当,有助于沟通实践融入任务执行,还讨论了相关设计考量。
AI 中文摘要
自闭症个体在工作场所沟通中常面临障碍,软技能蕴含于持续任务和周围环境中,而非孤立的言语交流。近期工作将基于大语言模型的智能体引入基于VR的沟通训练并提出提示模式。在此基础上,本文探索不同程度的环境基础如何影响自闭症受训者和职业教练的训练体验。通过9名自闭症受训者和7名职业教练参与的探索性研究,涵盖仅对话(C)、与环境物体对话(C+O)、与物体及抓握交互对话(C+O+G)三种模式。各模式下可用性和工作量相当,受训者和教练都更喜欢更具交互性和环境基础的C+O+G模式,认为其有助于保持参与度并将沟通实践融入任务执行。本文还讨论了为自闭症个体设计更灵活、交互式和与工作场所相关的VR沟通训练的考虑因素。
英文摘要
Autistic individuals often face barriers in workplace communication, where soft skills are embedded within ongoing tasks and surrounding environment context, not in isolated verbal exchange. Recent work has introduced LLM-driven agents into VR-based communication training and proposed prompting schemas that let agents generate dialogue grounded in the VR environment and the user's hand-based interactions. Building on this work, we explore how different levels of environmental grounding influence the training experience of autistic trainees and job coaches. We conducted an exploratory study with 9 autistic trainees and 7 job coaches across three modalities: conversation-only (C), conversation with environmental objects (C+O), and conversation with objects and grasp interactions (C+O+G). Usability and workload were comparable across modalities, while both trainees and coaches preferred the more interactive and environment-grounded condition (C+O+G). Participants viewed C+O+G as helpful for sustaining engagement and integrating communication practice into task performance. We discuss design considerations for more flexible, interactive, and workplace-relevant VR communication training for autistic individuals.
Comments14 pages, ASSETS2026
Journal refThe 28th International ACM SIGACCESS Conference on Computers and Accessibility (ASSETS 2026)