arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.02592cs.AI
收藏

面向安全可解释并网电动汽车的多模态大语言模型框架

Multimodal Large Language Model Framework for Safe and Interpretable Grid-Integrated EVs

Jean Douglas Carvalho, Hugo Kenji, Ahmad Mohammad Saber, Glaucia Melo, Max Mauro Dias Santos, Deepa Kundur

AI总结:

针对电动汽车并网中人车环境安全可解释交互的难题,提出融合视觉感知、定位与总线遥测的多模态大语言模型框架,经真实数据验证可生成情境告警,助力交通与能源系统优化。

摘要:

电动汽车(EV)接入智能电网为提升交通系统与能源网络性能带来了独特机遇。然而,确保驾驶员、车辆与周边环境之间安全且可解释的交互仍是一项关键挑战。本文提出一种基于多模态大语言模型(LLM)的框架,用于处理目标检测、语义分割、车辆遥测等多模态传感器数据,并为驾驶员生成自然语言告警。该框架利用在城市道路行驶的搭载传感设备的车辆所采集的真实数据进行验证,确保其适用于现实场景。框架结合视觉感知(YOLOv8)、地理编码定位与CAN总线遥测技术,在原始传感器数据与驾驶员理解之间搭建桥梁,助力城市驾驶场景下更安全、更明智的决策。基于真实数据的案例研究表明,该框架可有效针对行人、骑行者及其他车辆靠近等危急情况生成具备情境感知能力的告警。本文凸显了大语言模型作为电动出行辅助工具的潜力,其可通过实现可扩展的车队调度、电动汽车负荷预测以及交通感知能源规划,同时惠及交通系统与电力网络。

英文摘要:

The integration of electric vehicles (EVs) into smart grids presents unique opportunities to enhance both transportation systems and energy networks. However, ensuring safe and interpretable interactions between drivers, vehicles, and the surrounding environment remains a critical challenge. This paper presents a multi-modal large language model (LLM)-based framework to process multimodal sensor data - such as object detection, semantic segmentation, and vehicular telemetry - and generate natural-language alerts for drivers. The framework is validated using real-world data collected from instrumented vehicles driving on urban roads, ensuring its applicability to real-world scenarios. By combining visual perception (YOLOv8), geocoded positioning, and CAN bus telemetry, the framework bridges raw sensor data and driver comprehension, enabling safer and more informed decision-making in urban driving scenarios. Case studies using real data demonstrate the framework's effectiveness in generating context-aware alerts for critical situations, such as proximity to pedestrians, cyclists, and other vehicles. This paper highlights the potential of LLMs as assistive tools in e-mobility, benefiting both transportation systems and electric networks by enabling scalable fleet coordination, EV load forecasting, and traffic-aware energy planning. Index Terms - Electric vehicles, visual perception, large language models, YOLOv8, semantic segmentation, CAN bus, prompt engineering, smart grid.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑