arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09616cs.CV
收藏

通过(幻觉生成的)运动增强静态图像上的弱监督目标检测

Enhancing Weakly-Supervised Object Detection on Static Images through (Hallucinated) Motion

University of Pittsburgh(匹兹堡大学)

Cagri Gungor, Adriana Kovashka

AI总结:

本研究探索运动模态在静态图像弱监督目标检测中的潜力,提出整合幻觉运动、采用Siamese网络、运动归一化及选择性训练的增强方法,在COCO和YouTube-BB数据集上优于现有最优方法。

摘要:

尽管运动已在各类任务中受到关注,但其作为静态图像弱监督目标检测(WSOD)一种模态的潜力仍未被发掘。本研究提出一种通过整合运动信息来增强WSOD方法的途径。该方法包括利用从静态图像中幻觉生成的运动来提升图像数据集上的WSOD性能,采用Siamese网络(孪生网络)结合运动进行增强的表示学习,通过运动归一化处理相机运动,以及基于目标运动选择性地训练图像。在COCO和YouTube-BB数据集上的实验验证表明,该方法相比一种当前最优方法实现了性能提升。

英文摘要:

While motion has garnered attention in various tasks, its potential as a modality for weakly-supervised object detection (WSOD) in static images remains unexplored. Our study introduces an approach to enhance WSOD methods by integrating motion information. This method involves leveraging hallucinated motion from static images to improve WSOD on image datasets, utilizing a Siamese network for enhanced representation learning with motion, addressing camera motion through motion normalization, and selectively training images based on object motion. Experimental validation on the COCO and YouTube-BB datasets demonstrates improvements over a state-of-the-art method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑