在视频数据的海洋中航行:深度学习用于YouTube视频中的座头鲸分类
Navigating an Ocean of Video Data: Deep Learning for Humpback Whale Classification in YouTube Videos
摘要:
人工智能(AI)支持的图像分析技术已经证明,图像和视频是了解座头鲸(Megaptera novaeangliae)种群规模和动态的合适数据来源。随着社交媒体的出现,YouTube等平台提供了大量跨时空背景的视频数据,记录了世界各地用户遇到座头鲸的情况。在我们的工作中,我们专注于通过深度学习,根据YouTube视频是否记录了真正的座头鲸遭遇,自动将其分类为相关或不相关。我们使用在ImageNet数据集上预训练的CNN-RNN架构来将YouTube视频分类为相关或不相关。我们实现了平均85.7%的准确性,和84.7%(不相关)/ 86.6%(相关)的F1分数使用五重交叉验证对数据集进行评估。我们表明,深度学习可以作为一个时间效率高的步骤,使社交媒体成为生物多样性评估的图像和视频数据的可行来源。
英文摘要:
Image analysis technologies empowered by artificial intelligence (AI) have proved images and videos to be an opportune source of data to learn about humpback whale (Megaptera novaeangliae) population sizes and dynamics. With the advent of social media, platforms such as YouTube present an abundance of video data across spatiotemporal contexts documenting humpback whale encounters from users worldwide. In our work, we focus on automating the classification of YouTube videos as relevant or irrelevant based on whether they document a true humpback whale encounter or not via deep learning. We use a CNN-RNN architecture pretrained on the ImageNet dataset for classification of YouTube videos as relevant or irrelevant. We achieve an average 85.7% accuracy, and 84.7% (irrelevant)/ 86.6% (relevant) F1 scores using five-fold cross validation for evaluation on the dataset. We show that deep learning can be used as a time-efficient step to make social media a viable source of image and video data for biodiversity assessments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。