Over the years, hand gesture recognition has been mostly addressed considering hand trajectories in isolation. However, in most sign languages, hand gestures are defined on a particular context (body region). We propose a pipeline to perform sign language recognition which models hand movements in the context of other parts of the body captured in the 3D space using the MS Kinect sensor. In addition, we perform sign recognition based on the different hand postures that occur during a sign. Our experiments show that considering different body parts brings improved performance when compared to other methods which only consider global hand trajectories. Finally, we demonstrate that the combination of hand postures features with hand gestures features helps to improve the prediction of a given sign.
ICE-GAN: Identity-aware and Capsule-Enhanced GAN with Graph-based Reasoning for Micro-Expression Recognition and Synthesis
University of Sydney（悉尼大学）；University of New South Wales（新南威尔士大学）
微表情是人们真实情感和动机的反映，因此吸引了越来越多的研究者对人脸微表情自动识别的研究。短的检测窗口，微妙的面部肌肉运动和有限的训练样本使得微表情识别具有挑战性。为此，我们提出了一种新的基于图推理的身份感知和胶囊增强的生成对抗网络（ICE-GAN），引入微表情合成作为辅助任务来辅助识别。生成器生成具有可控微表情和身份感知特征的合成人脸，其长期依赖性通过图推理模块（GRM）捕获，并且该生成器检测图像真实性和表情类。我们的ICE-GAN在Micro-Expression Grand Challenge 2019（MEGC 2019）上进行了评估，与获奖者相比有显著改善（12.9%），并超过了其他最先进的方法。
Beyond Emotion Recognition: A Multi-Turn Multimodal Emotion Understanding and Reasoning Benchmark
Hefei University of Technology（合肥工业大学）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；University of Science and Technology of China（中国科学技术大学）；Institute of Artificial Intelligence (IAI), Hefei Comprehensive National Science Center（人工智能研究院（IAI），合肥综合性国家科学中心）
Skeleton-Based Action Recognition with Spatial Reasoning and Temporal Stack Learning
Center for Research on Intelligent Perception and Computing (CRIPAC), National Laboratory of Pattern Recognition (NLPR)（智能感知与计算研究中心（CRIPAC）、模式识别国家重点实验室（NLPR））；University of Chinese Academy of Sciences (UCAS)（中国科学院大学（UCAS））；Center for Excellence in Brain Science and Intelligence Technology (CEBSIT), Institute of Automation, Chinese Academy of Sciences (CASIA)（中国科学院自动化研究所（CASIA）脑科学与智能技术卓越创新中心（CEBSIT））
Multimodal Video Emotion Recognition with Reliable Reasoning Priors
Lenovo Research（联想研究院）；School of Artificial Intelligence, UCAS（中国科学院大学人工智能学院）；Institute of Automation, CAS（中国科学院自动化研究所）；Macau University of Science and Technology（澳门科学理工学院）；School of Computer Science and Technology, UCAS（中国科学院大学计算机科学与技术学院）
From Recognition to Prediction: Leveraging Sequence Reasoning for Action Anticipation
School of Electrical and Information Engineering, Tianjin University（天津大学电气与信息工程学院）；Lappeenranta-Lahti University of Technology LUT（拉彭兰塔-拉赫蒂理工大学LUT）；School of Computing and Information Technology, Great Bay University（大湾区大学计算与信息技术学院）
本文提出端到端架构 ARR，将动作预判分解为动作识别与序列推理，并通过 NAP 和无监督解码器预训练学习动作统计关系，在三个数据集上验证了有效性。
TRCoRSurg: Temporal-Relational Co-Reasoning for Surgical Video Triplet Recognition
Beihang University（北京航空航天大学）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）；Shenzhen University of Advanced Technology（深圳理工大学）
Breaking Déjà Vu: Independent Auditing of Visual Place Recognition through Vision-Language Reasoning
School of Electronics and Computer Science, University of Southampton（南安普顿大学电子与计算机科学学院）；School of Electrical Engineering and Computer Science, Queensland University of Technology（昆士兰科技大学电气工程与计算机科学学院）；School of Computer Science and Electronic Engineering, University of Essex（埃塞克斯大学计算机科学与电子工程学院）
On the Element-Wise Representation and Reasoning in Zero-Shot Image Recognition: A Systematic Survey
The Hong Kong Polytechnic University（香港理工大学）；The University of Queensland（昆士兰大学）；Hong Kong University of Science and Technology（香港科技大学）；Alibaba Group（阿里巴巴集团）；Nanyang Technological University（南洋理工大学）
Neurosymbolic Framework for Concept-Driven Logical Reasoning in Skeleton-Based Human Action Recognition
Department of ECSE, Faculty of Engineering, Monash University, Australia（莫纳什大学工程学院电子与计算机工程系，澳大利亚）；AIM for Health Lab, Faculty of Information Technology, Monash University, Australia（莫纳什大学信息科技学院健康人工智能实验室，澳大利亚）；Department of DSAI, Faculty of Information Technology, Monash University, Australia（莫纳什大学信息科技学院数据科学与人工智能系，澳大利亚）
Linear building pattern recognition via spatial knowledge graph
Institute of Electronic, Chinese Academy of Sciences（中国科学院电子学研究所）；School of Resources and Environment Science, Wuhan University（武汉大学资源与环境科学学院）；School of Software Engineering, Shenzhen Institute of Information Technology（深圳信息职业技术学院软件学院）；School of Information and Communication Engineering, Beijing University of Posts and Telecommunications（北京邮电大学信息与通信工程学院）
XEmoGPT: An Explainable Multimodal Emotion Recognition Framework with Cue-Level Perception and Reasoning
School of Computer Science and Engineering, University of Electronic Science and Technology of China（电子科技大学计算机科学与工程学院）；th Research Institute, China Electronics Technology Group Corporation（中国电子科技集团第五十四研究所）
Zero-shot Compositional Action Recognition with Neural Logic Constraints
College of Computer Science and Technology（计算机科学与技术学院）；Zhejiang University（浙江大学）；AI Chip Center for Emerging Smart Systems（新兴智能系统人工智能芯片中心）；The Hong Kong University of Science and Technology（香港科学与技术大学）
