Efficiently modeling spatial-temporal information in videos is crucial for action recognition. To achieve this goal, state-of-the-art methods typically employ the convolution operator and the dense interaction modules such as non-local blocks. However, these methods cannot accurately fit the diverse events in videos. On the one hand, the adopted convolutions are with fixed scales, thus struggling with events of various scales. On the other hand, the dense interaction modeling paradigm only achieves sub-optimal performance as action-irrelevant parts bring additional noises for the final prediction. In this paper, we propose a unified action recognition framework to investigate the dynamic nature of video content by introducing the following designs. First, when extracting local cues, we generate the spatial-temporal kernels of dynamic-scale to adaptively fit the diverse events. Second, to accurately aggregate these cues into a global video representation, we propose to mine the interactions only among a few selected foreground objects by a Transformer, which yields a sparse paradigm. We call the proposed framework as Event Adaptive Network (EAN) because both key designs are adaptive to the input video content. To exploit the short-term motions within local segments, we propose a novel and efficient Latent Motion Code (LMC) module, further improving the performance of the framework. Extensive experiments on several large-scale video datasets, e.g., Something-to-Something V1&V2, Kinetics, and Diving48, verify that our models achieve state-of-the-art or competitive performances at low FLOPs. Codes are available at: https://github.com/tianyuan168326/EAN-Pytorch.
Temporal-Channel Topology Enhanced Network for Skeleton-Based Action Recognition
National Laboratory of Pattern Recognition, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所模式识别国家重点实验室);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
An Attention Enhanced Graph Convolutional LSTM Network for Skeleton-Based Action Recognition
Institute of Automation, Chinese Academy of Sciences (CASIA)(中国科学院自动化研究所);University of Chinese Academy of Sciences (UCAS)(中国科学院大学);University of Science and Technology of China (USTC)(中国科学技术大学)
Frequency-Semantic Enhanced Variational Autoencoder for Zero-Shot Skeleton-based Action Recognition
University of North Carolina at Charlotte(夏洛特北卡罗来纳大学);Northern Illinois University(北伊利诺伊大学);Center for Research in Computer Vision, University of Central Florida(中佛罗里达大学计算机视觉研究中心)
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing(测绘遥感信息工程国家重点实验室);Wuhan University(武汉大学);Information Systems Technology and Design Pillar(信息系统技术与设计学院);Singapore University of Technology and Design(新加坡科技与设计大学);School of Geodesy and Geomatics(测绘学院);School of Mathematics and Statistics(数学与统计学院);Wuhan University Shenzhen Research Institute(武汉大学深圳研究院)
ICE-GAN: Identity-aware and Capsule-Enhanced GAN with Graph-based Reasoning for Micro-Expression Recognition and Synthesis
University of Sydney(悉尼大学);University of New South Wales(新南威尔士大学)
微表情是人们真实情感和动机的反映,因此吸引了越来越多的研究者对人脸微表情自动识别的研究。短的检测窗口,微妙的面部肌肉运动和有限的训练样本使得微表情识别具有挑战性。为此,我们提出了一种新的基于图推理的身份感知和胶囊增强的生成对抗网络(ICE-GAN),引入微表情合成作为辅助任务来辅助识别。生成器生成具有可控微表情和身份感知特征的合成人脸,其长期依赖性通过图推理模块(GRM)捕获,并且该生成器检测图像真实性和表情类。我们的ICE-GAN在Micro-Expression Grand Challenge 2019(MEGC 2019)上进行了评估,与获奖者相比有显著改善(12.9%),并超过了其他最先进的方法。
Illumination Normalization via Merging Locally Enhanced Textures for Robust Face Recognition
Wuhan University of Science and Technology(武汉科技大学);Institute of Robotics and Intelligent Systems, Wuhan University of Science and Technology(武汉科技大学机器人与智能系统研究院);Institute for Infocomm Research(信息通信研究院)
Identity-Enhanced Network for Facial Expression Recognition
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);IBM Research(IBM研究院);The Johns Hopkins University(约翰斯·霍普金斯大学)
SEED: Semantics Enhanced Encoder-Decoder Framework for Scene Text Recognition
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Developing and Refining a Multifunctional Facial Recognition System for Older Adults with Cognitive Impairments: A Journey Towards Enhanced Quality of Life
Faculty of Computer Sciences and Information Technology, King Abdulaziz University(阿卜杜勒阿齐兹大学计算机科学与信息技术学院);College of Computer and Information Sciences, King Saud University(沙特国王大学计算机与信息科学学院)
Searching Multi-Rate and Multi-Modal Temporal Enhanced Networks for Gesture Recognition
University of Oulu(奥卢大学);Macau University of Science and Technology(澳门科技大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Westlake University(西湖大学)
Enhanced Biologically Inspired Model for Image Recognition Based on a Novel Patch Selection Method with Moment
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);The State Key Laboratory of Management and Control for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所复杂系统管理与控制国家重点实验室);CAS Center for Excellence in Brain Science and Intelligence Technology(中国科学院脑科学与智能技术卓越创新中心);Nanchang University(南昌大学)
CMFN: Cross-Modal Fusion Network for Irregular Scene Text Recognition
Intelligent Software Research Center, Institute of Software Chinese Academy of Sciences(中国科学院软件研究所智能软件研究中心);University of Chinese Academy of Sciences(中国科学院大学);The Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所复杂系统认知与决策智能实验室);State Key Laboratory of Computer Science, Institute of Software Chinese Academy of Sciences(中国科学院软件研究所计算机科学国家重点实验室)
Knowledge-Enhanced Facial Expression Recognition with Emotional-to-Neutral Transformation
Hong Kong Baptist University(香港浸会大学);Xidian University(西安电子科技大学);Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);Chongqing University of Posts and Telecommunications(重庆邮电大学)
Hybrid-supervised Hypergraph-enhanced Transformer for Micro-gesture Based Emotion Recognition
School of Electronics and Information at Northwestern Polytechnical University(西北工业大学电子与信息学院);Innovation Center NPU Chongqing(西北工业大学重庆创新中心);University of Oulu(奥卢大学)
Learning from Mistakes: Loss-Aware Memory Enhanced Continual Learning for LiDAR Place Recognition
Shanghai Research Institute for Intelligent Autonomous System, Tongji University(上海智能自主系统研究院,同济大学);Department of Computer Science and Technology, School of Electronics and Information Engineering, Tongji University(计算机科学与技术系,电子信息工程学院,同济大学);MOE Key Lab of Embedded System and Service Computing, Tongji University(教育部嵌入式系统与服务计算重点实验室,同济大学);Institute of Intelligent Vehicles, Tongji University(智能车辆研究院,同济大学);College of Surveying and Geo-Informatics, Tongji University(测绘地理信息学院,同济大学)
Incorporating Scene Context and Semantic Labels for Enhanced Group-level Emotion Recognition
School of Computer Science and Communication Engineering, Jiangsu University(江苏大学计算机科学与通信工程学院);Oulu School, Nanjing Institute of Technology(南京理工大学奥卢学院);School of Management, Southeast University(东南大学管理学院);Key Laboratory of Child Development and Learning Science (Southeast University), Ministry of Education, Southeast University(教育部儿童发展与学习科学重点实验室(东南大学))
Mamba-Enhanced Text-Audio-Video Alignment Network for Emotion Recognition in Conversations
College of Big Data and Internet(大数据与互联网学院);Shenzhen Technology University(深圳技术大学);Institute of Advanced Computing and Digital Engineering(先进计算与数字工程研究所);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)