XR-CareerAssist:一种结合扩展现实与多模态AI的沉浸式个性化职业指导平台
XR-CareerAssist: An Immersive Platform for Personalised Career Guidance Leveraging Extended Reality and Multimodal AI
AI总结:
本文提出XR-CareerAssist平台,结合扩展现实与多模态AI,提供沉浸式、多语言的职业指导。系统整合语音识别、神经机器翻译、对话训练助手、视觉-语言模型和3D虚拟形象,通过动态Sankey图展示职业轨迹,实验显示高准确率和用户满意度。
摘要:
传统职业指导平台依赖静态文本界面,难以吸引用户或提供个性化、证据支持的见解。尽管计算机辅助职业指导系统自20世纪60年代以来有所发展,但其交互性仍有限,并未充分关注职业发展中的叙述维度。我们引入XR-CareerAssist平台,将扩展现实(XR)与多个AI模块结合,提供沉浸式、多语言的职业指导。该系统整合自动语音识别用于语音驱动交互,神经机器翻译支持英语、希腊语、法语和意大利语,基于Langchain的对话训练助手用于个性化对话,基于BLIP的视觉-语言模型用于职业可视化,以及通过交互式3D虚拟形象提供的AWS Polly文本到语音服务。职业轨迹以动态Sankey图呈现,源自超过10万条匿名职业档案库。该应用使用Unity构建,适用于Meta Quest 3,后端服务托管在AWS上。在埃克塞特大学的试点评估中,23名参与者返回了95.6%的语音识别准确率、78.3%的整体用户满意度和91.3%的系统响应性好评,反馈指导了后续对运动舒适度、音频清晰度和文本可读性的改进。XR-CareerAssist展示了XR与AI融合如何产生更具吸引力、可访问性和有效性的职业发展工具,其中在单一沉浸环境中整合五个AI模块,产生了区别于现有职业指导平台的多模态交互体验。
英文摘要:
Conventional career guidance platforms rely on static, text-driven interfaces that struggle to engage users or deliver personalised, evidence-based insights. Although Computer-Assisted Career Guidance Systems have evolved since the 1960s, they remain limited in interactivity and pay little attention to the narrative dimensions of career development. We introduce XR-CareerAssist, a platform that unifies Extended Reality (XR) with several Artificial Intelligence (AI) modules to deliver immersive, multilingual career guidance. The system integrates Automatic Speech Recognition for voice-driven interaction, Neural Machine Translation across English, Greek, French, and Italian, a Langchain-based conversational Training Assistant for personalised dialogue, a BLIP-based Vision-Language model for career visualisations, and AWS Polly Text-to-Speech delivered through an interactive 3D avatar. Career trajectories are rendered as dynamic Sankey diagrams derived from a repository of more than 100,000 anonymised professional profiles. The application was built in Unity for Meta Quest 3, with backend services hosted on AWS. A pilot evaluation at the University of Exeter with 23 participants returned 95.6% speech recognition accuracy, 78.3% overall user satisfaction, and 91.3% favourable ratings for system responsiveness, with feedback informing subsequent improvements to motion comfort, audio clarity, and text legibility. XR-CareerAssist demonstrates how the fusion of XR and AI can produce more engaging, accessible, and effective career development tools, with the integration of five AI modules within a single immersive environment yielding a multimodal interaction experience that distinguishes it from existing career guidance platforms.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。