arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.02683cs.CVeess.IV
收藏

广义事件相机

Generalized Event Cameras

University of Wisconsin-Madison(威斯康星大学麦迪逊分校);NovoViz(诺沃维兹);École Polytechnique Fédérale de Lausanne(洛桑联邦理工学院)

Varun Sundar, Matthew Dutson, Andrei Ardelean, Claudio Bruschini, Edoardo Charbon, Mohit Gupta

AI总结:

本文提出广义事件相机,利用单光子传感器在低带宽下保留场景强度,实现高速高保真成像并支持即插即用下游推理。

摘要:

事件相机以高时间分辨率和极低的带宽需求捕捉世界。然而,事件流仅编码亮度变化,不包含足够的场景信息来支持多种多样的下游任务。在本工作中,我们设计了广义事件相机,其以带宽高效的方式固有地保留场景强度。我们从事件何时生成以及传输何种信息这两个方面对事件相机进行广义化。为实现我们的设计,我们采用单光子传感器,它们提供对单个光子探测的数字访问;这种模态使我们能够灵活地实现丰富的广义事件相机空间。我们的单光子事件相机能够在低读出率下实现高速、高保真成像。因此,这些事件相机可以支持即插即用的下游推理,而无需采集新的事件数据集或设计专门的事件视觉模型。作为一个实际意义,我们的设计涉及轻量级且接近传感器兼容的计算,提供了一种无需高昂带宽成本即可使用单光子传感器的方法。

英文摘要:

Event cameras capture the world at high time resolution and with minimal bandwidth requirements. However, event streams, which only encode changes in brightness, do not contain sufficient scene information to support a wide variety of downstream tasks. In this work, we design generalized event cameras that inherently preserve scene intensity in a bandwidth-efficient manner. We generalize event cameras in terms of when an event is generated and what information is transmitted. To implement our designs, we turn to single-photon sensors that provide digital access to individual photon detections; this modality gives us the flexibility to realize a rich space of generalized event cameras. Our single-photon event cameras are capable of high-speed, high-fidelity imaging at low readout rates. Consequently, these event cameras can support plug-and-play downstream inference, without capturing new event datasets or designing specialized event-vision models. As a practical implication, our designs, which involve lightweight and near-sensor-compatible computations, provide a way to use single-photon sensors without exorbitant bandwidth costs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑