arXiv 1806.109932018-06-27eess.IVeess.SP

Framework for High-performance Video Acquisition and Processing in MTCA.4 Form Factor

Aleksander Mielczarek, Dariusz Makowski, Piotr Perek, Andrzej Napieralski

备注：: 2 pages, 2 figures, short form article for Real-Time 2018 Conference
DOI：: 10.1109/TNS.2019.2910878

英文摘要：

The video acquisition and processing systems are commonly used in industrial and scientific applications. Many of them utilize Camera Link interface for the transmission of a video stream from the camera to the host system. The framework presented in the paper enables capturing such data, processing it and transmitting to the host CPU. It consist of MTCA.4-compliant frame grabber and a set of software libraries supporting several different cameras. It is designed for use in large scale physics experiments such as ITER tokamak or European X-Ray Free-Electron Laser (E-XFEL), as well as in the Centre for Free-Electron Laser Science (CFEL). The proposed video acquisition solution features the worlds first Camera Link frame grabber for the MTCA.4 architecture. Thanks to the modern FPGA circuit architecture, the deserialization is done using only the built-in ISERDES primitives, which reduces the costs and complexity of the required hardware.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

FourierCam:A camera for video spectrum acquisition in single-shot

The novel camera architecture facilitates the development of machine vision. Instead of capturing frame sequences in the temporal domain as traditional video cameras, FourierCam directly measures the pixel-wise temporal spectrum of the video in single-shot through optical coding. Compared with the classic video cameras and time-frequency transformation pipeline, this programmable frequency-domain sampling strategy has an attractive combination of characteristics for low detection bandwidth, low-light imaging, low computational burden and low data volume. Based on the various temporal filter ke…

2020-10-30eess.IVphysics.optics

A Dual Camera System for High Spatiotemporal Resolution Video Acquisition

Nanjing University（南京大学）；University of California at Riverside（加州大学河滨分校）；Shanghai JiaoTong University（上海交通大学）

This paper presents a dual camera system for high spatiotemporal resolution (HSTR) video acquisition, where one camera shoots a video with high spatial resolution and low frame rate (HSR-LFR) and another one captures a low spatial resolution and high frame rate (LSR-HFR) video. Our main goal is to combine videos from LSR-HFR and HSR-LFR cameras to create an HSTR video. We propose an end-to-end learning framework, AWnet, mainly consisting of a FlowNet and a FusionNet that learn an adaptive weighting function in pixel domain to combine inputs in a frame recurrent fashion. To improve the reconstr…

2020-03-24cs.CVeess.IV

Pix2HDR——用于高速 HDR 视频的逐像素采集与基于深度学习的合成方法

Pix2HDR -- A pixel-wise acquisition and deep learning-based synthesis approach for high-speed HDR videos

The Johns Hopkins University（约翰斯·霍普金斯大学）；Massachusetts Institute of Technology（麻省理工学院）

提出 Pix2HDR 方法，利用逐像素可编程传感器进行变曝光采样，结合深度神经网络合成高时空分辨率的高速 HDR 视频，有效消除运动伪影并解析极端光照下的快速运动。

2024-04-25cs.CVeess.IV

An Adaptive Video Acquisition Scheme for Object Tracking and its Performance Optimization

We present a novel adaptive host-chip modular architecture for video acquisition to optimize an overall objective task constrained under a given bit rate. The chip is a high resolution imaging sensor such as gigapixel focal plane array (FPA) with low computational power deployed on the field remotely, while the host is a server with high computational power. The communication channel data bandwidth between the chip and host is constrained to accommodate transfer of all captured data from the chip. The host performs objective task specific computations and also intelligently guides the chip to …

2021-02-24eess.IV

GPU-accelerated SIFT-aided source identification of stabilized videos

University of Trento（特伦托大学）；University of Vigo（维戈大学）

Video stabilization is an in-camera processing commonly applied by modern acquisition devices. While significantly improving the visual quality of the resulting videos, it has been shown that such operation typically hinders the forensic analysis of video signals. In fact, the correct identification of the acquisition source usually based on Photo Response non-Uniformity (PRNU) is subject to the estimation of the transformation applied to each frame in the stabilization phase. A number of techniques have been proposed for dealing with this problem, which however typically suffer from a high co…

2022-07-29cs.CVcs.MMeess.IV

通过长方形随机采集神经成像（NORA）实现快速双光子显微术

Fast Two-photon Microscopy by Neuroimaging with Oblong Random Acquisition (NORA)

本文提出NORA计算成像方法，通过随机线采样子采样、慢扫描方向点扩散函数扩展及像素-时间矩阵核范数最小化恢复视频，实现最高20倍加速的双光子神经成像。

2025-06-09eess.IVeess.SPphysics.optics

更多相关论文收起更多论文

Key frames assisted hybrid encoding for photorealistic compressive video sensing

Snapshot compressive imaging (SCI) encodes high-speed scene video into a snapshot measurement and then computationally makes reconstructions, allowing for efficient high-dimensional data acquisition. Numerous algorithms, ranging from regularization-based optimization and deep learning, are being investigated to improve reconstruction quality, but they are still limited by the ill-posed and information-deficient nature of the standard SCI paradigm. To overcome these drawbacks, we propose a new key frames assisted hybrid encoding paradigm for compressive video sensing, termed KH-CVS, that altern…

2022-07-26eess.IV

TempRetinex：基于Retinex的无监督低光视频增强方法用于多样的光照条件

TempRetinex: Retinex-based Unsupervised Enhancement for Low-light Video Under Diverse Lighting Conditions

本文提出TempRetinex，一种基于Retinex的无监督视频增强框架，通过帧间相关性提升低光视频在多光照条件下的质量。引入亮度一致性预处理、多尺度时间一致性损失和遮挡感知掩膜技术，结合反推推理和自集合机制，实现高质量的低光视频增强。

2026-04-01eess.IV

Snapshot HDR Video Construction Using Coded Mask

National Center for Data Analytics and Artificial Intelligence（国家数据分析与人工智能中心）；KACST（阿卜杜勒-阿齐兹国王科技城）；Visual Computing Center（视觉计算中心）；KAUST（阿卜杜拉国王科技大学）

This paper study the reconstruction of High Dynamic Range (HDR) video from snapshot-coded LDR video. Constructing an HDR video requires restoring the HDR values for each frame and maintaining the consistency between successive frames. HDR image acquisition from single image capture, also known as snapshot HDR imaging, can be achieved in several ways. For example, the reconfigurable snapshot HDR camera is realized by introducing an optical element into the optical stack of the camera; by placing a coded mask at a small standoff distance in front of the sensor. High-quality HDR image can be reco…

2021-12-05cs.CVeess.IV

Video Reconstruction from a Single Motion Blurred Image using Learned Dynamic Phase Coding

Tel Aviv University（特拉维夫大学）

Video reconstruction from a single motion-blurred image is a challenging problem, which can enhance the capabilities of existing cameras. Recently, several works addressed this task using conventional imaging and deep learning. Yet, such purely-digital methods are inherently limited, due to direction ambiguity and noise sensitivity. Some works proposed to address these limitations using non-conventional image sensors, however, such sensors are extremely rare and expensive. To circumvent these limitations with simpler means, we propose a hybrid optical-digital method for video reconstruction th…

2022-12-18cs.CVeess.IV

高分辨率超声视频的盲复原

Blind Restoration of High-Resolution Ultrasound Video

Department of Mathematics, City University of Hong Kong（香港城市大学数学系）；Hong Kong Centre for Cerebro-cardiovascular Health Engineering（香港脑心血管健康工程中心）；Department of the Arts, University of Bologna（博洛尼亚大学艺术系）；Department of Computer Science and Engineering, University of Bologna（博洛尼亚大学计算机科学与工程系）；Department of Operations and Risk Management and School of Data Science, Lingnan University（岭南大学运营与风险管理系及数据科学学院）

针对超声视频低信噪比、低分辨率及预训练模型泛化性差的问题，提出自监督算法DUP，无需配对数据即可实现视频超分辨率与去噪，性能优于现有算法，助力下游应用。

2025-05-20cs.CVeess.IV

A data set providing synthetic and real-world fisheye video sequences

Signal Processing Friedrich-Alexander University Erlangen-N\"urnberg (FAU), Cauerstr. 7, 91058 Erlangen, Germany

In video surveillance as well as automotive applications, so-called fisheye cameras are often employed to capture a very wide angle of view. As such cameras depend on projections quite different from the classical perspective projection, the resulting fisheye image and video data correspondingly exhibits non-rectilinear image characteristics. Typical image and video processing algorithms, however, are not designed for these fisheye characteristics. To be able to develop and evaluate algorithms specifically adapted to fisheye images and videos, a corresponding test data set is therefore introdu…

2022-11-30cs.CVeess.IV

使用编码孔径与事件的高时间效率光场采集

Time-Efficient Light-Field Acquisition Using Coded Aperture and Events

Nagoya University（名古屋大学）；Osaka University（大阪大学）

本文提出将编码孔径序列与事件相机结合，在单次曝光内联合图像帧和事件重建光场，并设计了可端到端训练的深度光学算法流程，实验证明其重建精度优于多种单曝光成像方法。

2024-03-12cs.CVeess.IV

Convolutional sparse coding for capturing high speed video content

Universidad de Zaragoza（萨拉戈萨大学）；I3A（阿拉贡工程研究所）；MPI Informatik（马克斯·普朗克信息学研究所）

Video capture is limited by the trade-off between spatial and temporal resolution: when capturing videos of high temporal resolution, the spatial resolution decreases due to bandwidth limitations in the capture system. Achieving both high spatial and temporal resolution is only possible with highly specialized and very expensive hardware, and even then the same basic trade-off remains. The recent introduction of compressive sensing and sparse reconstruction techniques allows for the capture of single-shot high-speed video, by coding the temporal information in a single frame, and then reconstr…

2018-06-13cs.CVcs.GReess.IV

Deep Recurrent Neural Network with Multi-scale Bi-directional Propagation for Video Deblurring

Xian Jiaotong University（西安交通大学）；ByteDance Intelligent Creation Lab（字节跳动智能创作实验室）；Nanjing University of Science and Technology（南京理工大学）

The success of the state-of-the-art video deblurring methods stems mainly from implicit or explicit estimation of alignment among the adjacent frames for latent video restoration. However, due to the influence of the blur effect, estimating the alignment information from the blurry adjacent frames is not a trivial task. Inaccurate estimations will interfere the following frame restoration. Instead of estimating alignment information, we propose a simple and effective deep Recurrent Neural Network with Multi-scale Bi-directional Propagation (RNN-MBP) to effectively propagate and gather the info…

2021-12-09cs.CVeess.IV

100,000 frames-per-second compressive imaging with a conventional rolling-shutter camera by random point-spread-function engineering

We demonstrate an approach that allows taking videos at very high-speeds of over 100,000 frames per second (fps) by exploiting the fast sampling rate of the standard rolling-shutter readout mechanism, common to most conventional sensors, and a compressive-sampling acquisition scheme. Our approach is directly applied to a conventional imaging system by the simple addition of a diffuser to the pupil plane, randomly encoding the entire field-of-view to each camera row, while maintaining diffraction-limited resolution. A short video is reconstructed from a single camera frame via a compressed-sens…

2020-04-20eess.IVphysics.optics