arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.08615cs.CVcs.AI
收藏

MARINER:一种基于3E驱动的基准,用于开放水域环境中的细粒度感知与复杂推理

MARINER: A 3E-Driven Benchmark for Fine-Grained Perception and Complex Reasoning in Open-Water Environments

Guangdong University of Technology(广东工业大学)

Xingming Liao, Ning Chen, Muying Shu, Yunpeng Yin, Peijian Zeng, Zhuowei Wang, Nankai Lin, Lianglun Cheng

AI总结:

本文提出MARINER基准,通过3E框架评估开放水域环境中的细粒度感知与复杂推理,揭示先进模型在复杂海洋场景中的局限性。

摘要:

现实世界中的开放水域环境中的细粒度视觉理解和高层推理研究不足,由于缺乏专门的基准。我们介绍了MARINER,一个基于新颖的实体-环境-事件(3E)范式构建的综合基准。MARINER包含16,629个多源海洋图像,包含63个细粒度船只类别、多样的恶劣环境和5种典型动态海洋事件,涵盖细粒度分类、目标检测和视觉问答任务。我们对主流多模态大语言模型(MLLMs)进行了广泛评估,并建立了基线,发现即使先进模型在复杂海洋场景中也难以进行细粒度辨别和因果推理。作为专门的海洋基准,MARINER填补了海洋多模态理解的现实和认知层面评估的空白,并推动了未来关于鲁棒视觉-语言模型在开放水域应用中的研究。附录和补充材料可在https://lxixim.github.io/MARINER获取。

英文摘要:

Fine-grained visual understanding and high-level reasoning in real-world open-water environments remain under-explored due to the lack of dedicated benchmarks. We introduce MARINER, a comprehensive benchmark built under the novel Entity-Environment-Event (3E) paradigm. MARINER contains 16,629 multi-source maritime images with 63 fine-grained vessel categories, diverse adverse environments, and 5 typical dynamic maritime incidents, covering fine-grained classification, object detection, and visual question answering tasks. We conduct extensive evaluations on mainstream Multimodal Large language models (MLLMs) and establish baselines, revealing that even advanced models struggle with fine-grained discrimination and causal reasoning in complex marine scenes. As a dedicated maritime benchmark, MARINER fills the gap of realistic and cognitive-level evaluation for maritime multimodal understanding, and promotes future research on robust vision-language models for open-water applications. Appendix and supplementary materials are available at https://lxixim.github.io/MARINER.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑