E2V-SDE: From Asynchronous Events to Fast and Continuous Video Reconstruction via Neural Stochastic Differential Equations
Jongwan Kim, DongJin Lee, Byunggook Na, Seongsik Park, Jeonghee Jo, Sungroh Yoon
备注:
arXiv admin note: This submission has been withdrawn by arXiv administrators due to inappropriate text overlap with external sources. Additional information at https://doi.org/10.1109/CVPR52688.2022.01319
发表信息:
The IEEE / CVF Computer Vision and Pattern Recognition Conference 2022
Event cameras respond to brightness changes in the scene asynchronously and independently for every pixel. Due to the properties, these cameras have distinct features: high dynamic range (HDR), high temporal resolution, and low power consumption. However, the results of event cameras should be processed into an alternative representation for computer vision tasks. Also, they are usually noisy and cause poor performance in areas with few events. In recent years, numerous researchers have attempted to reconstruct videos from events. However, they do not provide good quality videos due to a lack of temporal information from irregular and discontinuous data. To overcome these difficulties, we introduce an E2V-SDE whose dynamics are governed in a latent space by Stochastic differential equations (SDE). Therefore, E2V-SDE can rapidly reconstruct images at arbitrary time steps and make realistic predictions on unseen data. In addition, we successfully adopted a variety of image composition techniques for improving image clarity and temporal consistency. By conducting extensive experiments on simulated and real-scene datasets, we verify that our model outperforms state-of-the-art approaches under various video reconstruction settings. In terms of image quality, the LPIPS score improves by up to 12% and the reconstruction speed is 87% higher than that of ET-Net.
Department of Electrical and Computer Engineering, Northwestern University(电气与计算机工程系,西北大学);Department of Materials Science and Engineering, Northwestern University(材料科学与工程系,西北大学);Applied Physics Program, Northwestern University(应用物理项目,西北大学)
High-Frequency Space Diffusion Models for Accelerated MRI
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Shenzhen University(深圳大学);Pazhou Lab(琶洲实验室)
3D Trajectory Reconstruction of Moving Points Based on Asynchronous Cameras
College of Aerospace Science and Engineering, National University of Defense Technology(航空科学与工程学院,国防科技大学);Hunan Provincial Key Laboratory of Image Measurement and Vision Navigation(湖南省图像测量与视觉导航重点实验室)
Asynchronous Remote Sensing Time-Series Fusion for Cloud Removal and Anytime Reconstruction
School of Computing and Augmented Intelligence, Arizona State University(计算与增强智能学院,亚利桑那州立大学);School of Geographical Sciences and Urban Planning, Arizona State University(地理科学与城市规划学院,亚利桑那州立大学);Woodwell Climate Research Center(伍德沃德气候研究中心)
Projection Embedded Diffusion Bridge for CT Reconstruction from Incomplete Data
The Department of Engineering Physics, Tsinghua University(清华大学工程物理系);Center for Advanced Medical Computing and Analysis, Massachusetts General Hospital and Harvard Medical School(麻省总医院和哈佛医学院高级医学计算与分析中心);Department of Radiology, The Ohio State University(俄亥俄州立大学放射科)
SPIRiT-Diffusion: Self-Consistency Driven Diffusion Model for Accelerated MRI
Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院劳特伯生物医学成像研究中心);Research Center for Medical AI, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院医学人工智能研究中心);School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University(深圳大学医学部生物医学工程学院)
eBIRD: Event-based Intensity Image Reconstruction Using Controllable Diffusion Models
Institute of Engineering Sciences, Universidad de O’Higgins(奥伊金斯大学工程科学学院);The Iniciativa de Datos e Inteligencia Artificial, University of Chile(智利大学数据与人工智能倡议)
DyCrowd: Towards Dynamic Crowd Reconstruction from a Large-scene Video
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学院);Beijing National Research Center for Information Science and Technology, Tsinghua University(清华大学信息科学与技术全国重点研究院);School of Computer Science and Informatics, Cardiff University(卡迪夫大学计算机科学与信息学学院)
Semantic-E2VID: a Semantic-Enriched Paradigm for Event-to-Video Reconstruction
organization= Department of Electrical;Electronic Engineering, The University of Hong Kong , city= Hong Kong , country= China;organization= School of Artificial Intelligence, Beijing University of Posts;organization= State Key Laboratory of Multimedia Information Processing;National Engineering Research Center of Visual Technology, School of Computer Science, Peking University , city= Beijing , postcode= 100871 , country= China
Formulating Event-based Image Reconstruction as a Linear Inverse Problem with Deep Regularization using Optical Flow
Technische Universität Berlin(柏林工业大学);Einstein Center Digital Future(爱因斯坦数字未来中心);Science of Intelligence Excellence Cluster(科学卓越集群);Georgia Institute of Technology(佐治亚理工学院)