arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.01931cs.CV
收藏

MarineDet:面向开放海洋目标检测

MarineDet: Towards Open-Marine Object Detection

University of Electronic Science and Technology of China(电子科技大学);Hong Kong University of Science and Technology(香港科技大学)

Liang Haixin, Zheng Ziqiang, Ma Zeyu, Sai-Kit Yeung

AI总结:

针对开放海洋目标检测(OMOD)需求,该研究提出MarineDet方法,通过预训练构建多模态语义空间结合海洋专属训练实现知识迁移,构建含821类的专用数据集,性能优于现有算法,为OMOD提供标准流程。

摘要:

海洋目标检测在海洋研究中日益受到重视,其驱动力来自揭开海洋奥秘、深化我们对宝贵海洋生态系统认知的迫切需求。当前亟需高效、准确地在水下图像中识别并定位多样且未见过的海洋实体。开放海洋目标检测(简称OMOD)要求检测多样且未见过的海洋目标,同时完成分类与定位任务。为实现OMOD,我们提出了MarineDet。我们通过预训练构建联合视觉-文本语义空间,随后开展海洋专属训练,以实现从空中到海洋的知识迁移。考虑到目前没有专为OMOD设计的数据集,我们构建了包含821个海洋相关目标类别的MarineDet数据集,用于推动和衡量OMOD的性能。实验结果表明,MarineDet的性能优于现有的通用型和专用型目标检测算法。据我们所知,我们是首个提出OMOD的研究团队,该任务对海洋生态系统监测与管理具备更具价值的实用设置。我们的研究不仅拓展了海洋认知的边界,还为OMOD提供了一套标准流程。

英文摘要:

Marine object detection has gained prominence in marine research, driven by the pressing need to unravel oceanic mysteries and enhance our understanding of invaluable marine ecosystems. There is a profound requirement to efficiently and accurately identify and localize diverse and unseen marine entities within underwater imagery. The open-marine object detection (OMOD for short) is required to detect diverse and unseen marine objects, performing categorization and localization simultaneously. To achieve OMOD, we present \textbf{MarineDet}. We formulate a joint visual-text semantic space through pre-training and then perform marine-specific training to achieve in-air-to-marine knowledge transfer. Considering there is no specific dataset designed for OMOD, we construct a \textbf{MarineDet dataset} consisting of 821 marine-relative object categories to promote and measure OMOD performance. The experimental results demonstrate the superior performance of MarineDet over existing generalist and specialist object detection algorithms. To the best of our knowledge, we are the first to present OMOD, which holds a more valuable and practical setting for marine ecosystem monitoring and management. Our research not only pushes the boundaries of marine understanding but also offers a standard pipeline for OMOD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑