arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2401.03040cs.LGcs.AIcs.CVcs.DC
收藏

AccidentGPT:用于交通事故分析的大型多模态基础模型

AccidentGPT: Large Multi-Modal Foundation Model for Traffic Accident Analysis

Technology Innovation Institute(技术创新研究所)

Kebin Wu, Wenbin Li, Xiaofei Xiao

AI总结:

本文提出交通事故分析基础模型AccidentGPT,结合多模态输入与边云分离架构,实现事故过程自动重建及多任务多模态分析,克服传统方法的主观性、单模态和隐私问题。

摘要:

交通事故分析对于提升公共安全和制定道路法规至关重要。传统方法虽被广泛使用,但常受限于人工分析过程、主观决策、单模态输出以及与敏感数据相关的隐私问题。本文提出了AccidentGPT的理念,这是一个交通事故分析的基础模型,它结合多模态输入数据,自动重建带有动力学细节的事故过程视频,并进一步提供具有多模态输出的多任务分析。AccidentGPT的设计采用带有反馈的多模态提示以实现面向任务的适应性,采用混合训练模式以利用有标签和无标签数据,并采用边云分离配置以保护数据隐私。为充分实现该模型的功能,我们提出了若干研究机会。本文作为填补传统交通事故分析方法空白的垫脚石,旨在引起研究界对自动化、客观且保护隐私的交通事故分析的关注。

英文摘要:

Traffic accident analysis is pivotal for enhancing public safety and developing road regulations. Traditional approaches, although widely used, are often constrained by manual analysis processes, subjective decisions, uni-modal outputs, as well as privacy issues related to sensitive data. This paper introduces the idea of AccidentGPT, a foundation model of traffic accident analysis, which incorporates multi-modal input data to automatically reconstruct the accident process video with dynamics details, and furthermore provide multi-task analysis with multi-modal outputs. The design of the AccidentGPT is empowered with a multi-modality prompt with feedback for task-oriented adaptability, a hybrid training schema to leverage labelled and unlabelled data, and a edge-cloud split configuration for data privacy. To fully realize the functionalities of this model, we proposes several research opportunities. This paper serves as the stepping stone to fill the gaps in traditional approaches of traffic accident analysis and attract the research community attention for automatic, objective, and privacy-preserving traffic accident analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑