“发生了什么”——一款解释自动驾驶车辆行为的以人为中心的多模态解释器
"What's Happening"- A Human-centered Multimodal Interpreter Explaining the Actions of Autonomous Vehicles
AI总结:
针对公众对自动驾驶汽车信任不足的问题,提出融合BEV视觉界面、文本与微调LLM语音交互的以人为中心多模态解释器HMI,用户研究证实其可显著提升乘客信任度。
摘要:
公众对自动驾驶汽车的不信任感正在加剧。研究强调,有必要向乘客解释这类车辆的行为,以提升人们对自主系统的信任。解释器可通过提高透明度、降低感知风险来增强信任,但现有解决方案往往缺乏以人为中心的多模态解释整合方式。本文提出了一种新型的以人为中心的多模态解释器(Human-centered Multimodal Interpreter,HMI)系统,该系统结合人类偏好,提供视觉、文本和听觉反馈。系统整合了带有鸟瞰图(Bird's Eye View,BEV)、地图和文本显示的视觉界面,以及基于微调大语言模型(large language model,LLM)的语音交互功能。我们针对不同参与者开展的用户研究表明,HMI系统显著提升了乘客对自动驾驶汽车(AVs)的信任,平均信任水平提升超8%,普通环境下的信任度提升最高可达30%。这些结果凸显了HMI系统通过提供清晰、实时、情境敏感的车辆行为解释,提升自动驾驶汽车接受度与可靠性的潜力。
英文摘要:
Public distrust of self-driving cars is growing. Studies emphasize the need for interpreting the behavior of these vehicles to passengers to promote trust in autonomous systems. Interpreters can enhance trust by improving transparency and reducing perceived risk. However, current solutions often lack a human-centric approach to integrating multimodal interpretations. This paper introduces a novel Human-centered Multimodal Interpreter (HMI) system that leverages human preferences to provide visual, textual, and auditory feedback. The system combines a visual interface with Bird's Eye View (BEV), map, and text display, along with voice interaction using a fine-tuned large language model (LLM). Our user study, involving diverse participants, demonstrated that the HMI system significantly boosts passenger trust in AVs, increasing average trust levels by over 8%, with trust in ordinary environments rising by up to 30%. These results underscore the potential of the HMI system to improve the acceptance and reliability of autonomous vehicles by providing clear, real-time, and context-sensitive explanations of vehicle actions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。