arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.05081cs.LG
收藏

DriVLM:自动驾驶中视觉-语言模型的领域适应

DriVLM: Domain Adaptation of Vision-Language Models in Autonomous Driving

School of Electrical Engineering, KAIST(韩国科学技术院电气工程学院)

Xuran Zheng, Chang D. Yoo

AI总结:

针对多模态大语言模型计算资源需求过高的问题,本文探索小规模MLLM的效用,并通过DriVLM将其领域适应到自动驾驶场景,以促进真实落地。

摘要:

近年来,大语言模型取得了令人瞩目的性能,这在很大程度上推动了人工智能的发展与应用,而且模型的参数规模和性能仍在快速增长。特别是多模态大语言模型(MLLM)能够结合图片、视频、声音、文本等多种模态,在各类任务中具有巨大潜力。然而,大多数MLLM需要极高的计算资源,这对多数研究人员和开发者而言是一项重大挑战。本文中,我们探索了小规模MLLM的效用,并将小规模MLLM应用于自动驾驶领域。我们希望这能推动MLLM在真实场景中的应用。

英文摘要:

In recent years, large language models have had a very impressive performance, which largely contributed to the development and application of artificial intelligence, and the parameters and performance of the models are still growing rapidly. In particular, multimodal large language models (MLLM) can combine multiple modalities such as pictures, videos, sounds, texts, etc., and have great potential in various tasks. However, most MLLMs require very high computational resources, which is a major challenge for most researchers and developers. In this paper, we explored the utility of small-scale MLLMs and applied small-scale MLLMs to the field of autonomous driving. We hope that this will advance the application of MLLMs in real-world scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑