arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.21722cs.HCcs.AI
收藏

AquaVLM:利用移动视觉语言模型提升水下态势感知能力

AquaVLM: Improving Underwater Situation Awareness with Mobile Vision Language Models

University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)

Beitong Tian, Lingzhi Zhao, Bo Chen, Haozhen Zheng, Jingcheng Yang, Mingyuan Wu, Deepak Vasisht, Klara Nahrstedt

AI总结:

针对传统水下通信笨重且消息预定义的问题,本文提出AquaVLM系统,利用微调的移动视觉语言模型自动生成情境感知消息并通过智能手机传输,经VR模拟与iOS原型验证,有效提升水下态势感知与通信能力。

摘要:

水肺潜水等水下活动每年使数百万人能够探索海洋环境,用于娱乐和科学研究。保持态势感知和有效沟通对于潜水员的安全至关重要。传统的水下通信系统通常笨重且昂贵,限制了各级别潜水员的使用。虽然近期系统利用轻量级智能手机并支持文本消息,但这些消息是预定义的,因此限制了特定情境下的通信。本文提出AquaVLM,一种即点即发的水下通信系统,能够自动生成情境感知消息,并利用普遍存在的智能手机进行传输。该系统采用在自动生成的水下对话数据集上微调的移动视觉语言模型(VLM),并采用分层消息生成流水线。我们协同设计VLM与传输机制,引入容错微调以提高系统对传输错误的鲁棒性。我们开发了一个VR模拟器,使用户能够在逼真的水下环境中体验AquaVLM,并在iOS平台上创建了功能完整的原型,用于真实世界实验。主观和客观评估均验证了AquaVLM的有效性,并突显了其在个人水下通信以及更广泛的移动VLM应用中的潜力。

英文摘要:

Underwater activities like scuba diving enable millions annually to explore marine environments for recreation and scientific research. Maintaining situational awareness and effective communication are essential for diver safety. Traditional underwater communication systems are often bulky and expensive, limiting their accessibility to divers of all levels. While recent systems leverage lightweight smartphones and support text messaging, the messages are predefined and thus restrict context-specific communication. In this paper, we present AquaVLM, a tap-and-send underwater communication system that automatically generates context-aware messages and transmits them using ubiquitous smartphones. Our system features a mobile vision-language model (VLM) fine-tuned on an auto-generated underwater conversation dataset and employs a hierarchical message generation pipeline. We co-design the VLM and transmission, incorporating error-resilient fine-tuning to improve the system's robustness to transmission errors. We develop a VR simulator to enable users to experience AquaVLM in a realistic underwater environment and create a fully functional prototype on the iOS platform for real-world experiments. Both subjective and objective evaluations validate the effectiveness of AquaVLM and highlight its potential for personal underwater communication as well as broader mobile VLM applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑