arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.09302cs.CV
收藏

使用普通设备实现1000倍速度的相机和机器视觉

1000x Faster Camera and Machine Vision with Ordinary Devices

Peking University(北京大学)
Tiejun Huang, Yajing Zheng, Zhaofei Yu, Rui Chen, Yuan Li, Ruiqin Xiong, Lei Ma, Junwei Zhao, Siwei Dong, Lin Zhu, Jianing Li, Shanshan Jia, Yihua Fu, Boxin Shi… 展开作者

Tiejun Huang, Yajing Zheng, Zhaofei Yu, Rui Chen, Yuan Li, Ruiqin Xiong, Lei Ma, Junwei Zhao, Siwei Dong, Lin Zhu, Jianing Li, Shanshan Jia, Yihua Fu, Boxin Shi, Si Wu, Yonghong Tian

摘要:

在数码相机中,我们发现了一个主要的限制:从胶片相机继承的图像和视频形式阻碍了它捕捉快速变化的光子世界。在这里,我们提出了vidar,一个比特序列阵列,其中每个比特表示光子的积累是否已经达到阈值,以记录和重建场景的辐射在任何时刻。通过仅采用消费级CMOS传感器和集成电路,我们开发出了比传统相机快1,000倍的视频雷达相机。通过将Vidar视为生物视觉中的尖峰序列,我们进一步开发了一种基于脉冲神经网络的机器视觉系统,该系统结合了机器的速度和生物视觉的机制,实现了比人类视觉快1,000倍的高速目标检测和跟踪。我们演示了在助理裁判和目标指向系统中的视频摄像机和超级视觉系统的实用性。我们的研究有望从根本上彻底改变图像和视频概念以及相关行业,包括摄影,电影和视觉媒体,并开启一个新的脉冲神经网络-使能无速度机器视觉时代。

英文摘要:

In digital cameras, we find a major limitation: the image and video form inherited from a film camera obstructs it from capturing the rapidly changing photonic world. Here, we present vidar, a bit sequence array where each bit represents whether the accumulation of photons has reached a threshold, to record and reconstruct the scene radiance at any moment. By employing only consumer-level CMOS sensors and integrated circuits, we have developed a vidar camera that is 1,000x faster than conventional cameras. By treating vidar as spike trains in biological vision, we have further developed a spiking neural network-based machine vision system that combines the speed of the machine and the mechanism of biological vision, achieving high-speed object detection and tracking 1,000x faster than human vision. We demonstrate the utility of the vidar camera and the super vision system in an assistant referee and target pointing system. Our study is expected to fundamentally revolutionize the image and video concepts and related industries, including photography, movies, and visual media, and to unseal a new spiking neural network-enabled speed-free machine vision era.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑