Enhanced Spatio-Temporal Interaction Learning for Video Deraining: A Faster and Better Framework
College of Engineering and Computer Science, the Australian National University(澳大利亚国立大学工程与计算机学院);Tencent(腾讯);State Key Laboratory of Information Security, Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所信息安全国家重点实验室)
Kaihao Zhang, Dongxu Li, Wenhan Luo, Wenqi Ren, Wei Liu
Video deraining is an important task in computer vision as the unwanted rain hampers the visibility of videos and deteriorates the robustness of most outdoor vision systems. Despite the significant success which has been achieved for video deraining recently, two major challenges remain: 1) how to exploit the vast information among continuous frames to extract powerful spatio-temporal features across both the spatial and temporal domains, and 2) how to restore high-quality derained videos with a high-speed approach. In this paper, we present a new end-to-end video deraining framework, named Enhanced Spatio-Temporal Interaction Network (ESTINet), which considerably boosts current state-of-the-art video deraining quality and speed. The ESTINet takes the advantage of deep residual networks and convolutional long short-term memory, which can capture the spatial features and temporal correlations among continuing frames at the cost of very little computational source. Extensive experiments on three public datasets show that the proposed ESTINet can achieve faster speed than the competitors, while maintaining better performance than the state-of-the-art methods.
DeLiVR: Differential Spatiotemporal Lie Bias for Efficient Video Deraining
University of Chinese Academy of Sciences(中国科学院大学);Qilu University of Technology(齐鲁工业大学);Hubei University(湖北大学);Nanjing University of Science and Technology(南京理工大学);Shandong Normal University(山东师范大学);Nanjing University of Posts and Telecommunications(南京邮电大学)
PRE-Mamba: A 4D State Space Model for Ultra-High-Frequent Event Camera Deraining
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Harbin Institute of Technology(哈尔滨工业大学);Carnegie Mellon University(卡内基梅隆大学);Pengcheng Laboratory(鹏城实验室)
RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));The Hong Kong University of Science and Technology(香港科技大学);Hong Kong Metropolitan University(香港都会大学)
Large-scale, Fast and Accurate Shot Boundary Detection through Spatio-temporal Convolutional Neural Networks
Qatar Computing Research Institute, HBKU(卡塔尔计算研究所,哈马德·本·哈利法大学);Trinity College Dublin, CONNECT Center(都柏林圣三一学院,CONNECT中心);MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);Simon Fraser University(西蒙弗雷泽大学)
Semi-Supervised State-Space Model with Dynamic Stacking Filter for Real-World Video Deraining
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);School of Cyber Science and Technology, Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区计算机科学与技术学院);MoE Key Laboratory of Information Technology(教育部信息科技重点实验室);Guangdong Provincial Key Laboratory of Information Security Technology(广东省信息安全技术重点实验室);Key Laboratory of Educational Information for Nationalities, Yunnan Normal University(民族教育信息重点实验室,云南师范大学);School of Mechanical Engineering and Automation, Fuzhou University(福州大学机械工程与自动化学院)
FluidRain: Incompressible Rain Flow as an Attention Bias for Loop-in-Loop Video Deraining
Shandong University(山东大学);Central South University(中南大学);Nanjing University of Science and Technology(南京理工大学);Beijing University of Posts and Telecommunications(北京邮电大学);National University of Defense Technology(国防科技大学)
Learning Parallel Dense Correspondence from Spatio-Temporal Descriptors for Efficient and Robust 4D Reconstruction
South China University of Technology(华南理工大学);DAMO Academy, Alibaba Group(阿里巴巴达摩院);HKUST(香港科技大学);Pazhou Lab(琶洲实验室);Peng Cheng Laboratory(鹏城实验室);The Hong Kong Polytechnic University(香港理工大学)
ViStripformer: A Token-Efficient Transformer for Versatile Video Restoration
National Tsing Hua University(国立清华大学);National Chengchi University(国立政治大学);National Yang Ming Chiao Tung University(国立阳明交通大学);Qualcomm Technologies, Inc(高通技术公司)
Faster Image2Video Generation: A Closer Look at CLIP Image Embedding's Impact on Spatio-Temporal Cross-Attentions
The University of Western Australia(西澳大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Technical University of Munich(慕尼黑工业大学);The University of Melbourne(墨尔本大学);School of Information(信息学院);Department of Electrical, Electronics and Computer Engineering, The University of Western Australia(西澳大学电气、电子与计算机工程系)
Spatio-Temporal State Space Model For Efficient Event-Based Optical Flow
Advanced Research and Innovation Center (ARIC), Khalifa University, Abu Dhabi, UAE(高级研究与创新中心(ARIC),哈利法大学,阿布扎比,阿联酋);Department of Computer Science, Khalifa University of Science and Technology, Abu Dhabi, UAE(计算机科学系,哈利法科学技术大学,阿布扎比,阿联酋)
Self-supervised Action Representation Learning from Partial Spatio-Temporal Skeleton Sequences
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);The Chinese University of Hong Kong(香港中文大学);Shanghai AI Laboratory(上海人工智能实验室)
Unified theory for joint covariance properties under geometric image transformations for spatio-temporal receptive fields according to the generalized Gaussian derivative model for visual receptive fields
Computational Brain Science Lab(计算脑科学实验室);Division of Computational Science and Technology(计算科学与技术系);KTH Royal Institute of Technology(皇家理工学院)
Real-time 3D human action recognition based on Hyperpoint sequence
Hohai University(河海大学);School of Computer and Information, Hohai University(河海大学计算机与信息学院);Changzhou University(常州大学);Command and Control Engineering College, Army Engineering University of PLA(中国人民解放军陆军工程大学指挥与控制工程学院)
Social-IWSTCNN: A Social Interaction-Weighted Spatio-Temporal Convolutional Neural Network for Pedestrian Trajectory Prediction in Urban Traffic Scenarios
University of Gothenburg(哥德堡大学);Chalmers University of Technology(查尔姆斯理工大学)
CoDAT: Collaborative Dual-Attention Transformer with Low-Cost Temporal Modeling for Efficient Edge Action Recognition
National Formosa University(国立虎尾科技大学);University of Muhammadiyah Malang(马朗穆罕默迪亚大学);National Taiwan University of Science and Technology(台湾科技大学);National Yang Ming Chiao Tung University(国立阳明交通大学)