arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.13233cs.CVcs.RO
收藏

C^3Net:端到端深度学习,实现高效的实时的视觉主动摄像机控制

C^3Net: End-to-End deep learning for efficient real-time visual active camera control

KIOS Research and Innovation Center of Excellence(KIOS卓越研究与创新中心);University of Cyprus(塞浦路斯大学)

Christos Kyrkou

摘要:

在智能摄像机监控、智能环境和无人机等应用中对自动化实时的【形】视觉系统的需求需要改进视觉主动监测和控制方法。传统上,主动监控任务通过检测、过滤和控制等模块的流水线来处理。然而,这样的方法很难联合优化和调整它们的各种参数,以用于资源约束系统中的实时的【形】处理。本文提出了一种深度卷积相机控制器神经网络,直接从视觉信息到相机运动,为主动视觉问题提供有效的解决方案。它是端到端训练的,没有限界框注释来控制相机并从原始像素值跟踪多个目标。通过模拟框架和真实实验装置的评估表明,所提出的解决方案是强大的,以不同的条件下,能够实现更好的监测性能比传统的方法无论是在监测的目标数量以及在有效的监测时间。所提出的方法的优点是,它是计算要求较低,可以运行在超过10 FPS(~ 4倍加速比)的嵌入式智能摄像机提供了一个实用的和负担得起的解决方案,实时的【形】主动监测。

英文摘要:

The need for automated real-time visual systems in applications such as smart camera surveillance, smart environments, and drones necessitates the improvement of methods for visual active monitoring and control. Traditionally, the active monitoring task has been handled through a pipeline of modules such as detection, filtering, and control. However, such methods are difficult to jointly optimize and tune their various parameters for real-time processing in resource constraint systems. In this paper a deep Convolutional Camera Controller Neural Network is proposed to go directly from visual information to camera movement to provide an efficient solution to the active vision problem. It is trained end-to-end without bounding box annotations to control a camera and follow multiple targets from raw pixel values. Evaluation through both a simulation framework and real experimental setup, indicate that the proposed solution is robust to varying conditions and able to achieve better monitoring performance than traditional approaches both in terms of number of targets monitored as well as in effective monitoring time. The advantage of the proposed approach is that it is computationally less demanding and can run at over 10 FPS (~4x speedup) on an embedded smart camera providing a practical and affordable solution to real-time active monitoring.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑