Wavelet-Decoupling Contrastive Enhancement Network for Fine-Grained Skeleton-Based Action Recognition
Beijing Engineering Research Center of Mixed Reality and Advanced Display（北京混合现实与先进显示工程研究中心）；School of Optics and Photonics, Beijing Institute of Technology（北京理工大学光电学院）
Skeleton-based action recognition has attracted much attention, benefiting from its succinctness and robustness. However, the minimal inter-class variation in similar action sequences often leads to confusion. The inherent spatiotemporal coupling characteristics make it challenging to mine the subtle differences in joint motion trajectories, which is critical for distinguishing confusing fine-grained actions. To alleviate this problem, we propose a Wavelet-Attention Decoupling (WAD) module that utilizes discrete wavelet transform to effectively disentangle salient and subtle motion features in the time-frequency domain. Then, the decoupling attention adaptively recalibrates their temporal responses. To further amplify the discrepancies in these subtle motion features, we propose a Fine-grained Contrastive Enhancement (FCE) module to enhance attention towards trajectory features by contrastive learning. Extensive experiments are conducted on the coarse-grained dataset NTU RGB+D and the fine-grained dataset FineGYM. Our methods perform competitively compared to state-of-the-art methods and can discriminate confusing fine-grained actions well.
Nanjing University of Science and Technology（南京理工大学）
Contrastive learning has been successfully leveraged to learn action representations for addressing the problem of semi-supervised skeleton-based action recognition. However, most contrastive learning-based methods only contrast global features mixing spatiotemporal information, which confuses the spatial- and temporal-specific information reflecting different semantic at the frame level and joint level. Thus, we propose a novel Spatiotemporal Decouple-and-Squeeze Contrastive Learning (SDS-CL) framework to comprehensively learn more abundant representations of skeleton-based actions by jointly…
University of Chinese Academy of Sciences（中国科学院大学）；Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；CAS Center for Excellence in Brain Science and Intelligence Technology（中国科学院脑科学与智能技术卓越创新中心）
Dynamic skeletal data, represented as the 2D/3D coordinates of human joints, has been widely studied for human action recognition due to its high-level semantic information and environmental robustness. However, previous methods heavily rely on designing hand-crafted traversal rules or graph topologies to draw dependencies between the joints, which are limited in performance and generalizability. In this work, we present a novel decoupled spatial-temporal attention network(DSTA-Net) for skeleton-based action recognition. It involves solely the attention blocks, allowing for modeling spatial-te…
Beihang University（北京航空航天大学）；Zhongguancun Laboratory（中关村实验室）；Hangzhou Innovation Institute of Beihang University（北京航空航天大学杭州创新研究院）
Human action recognition aims at classifying the category of human action from a segment of a video. Recently, people have dived into designing GCN-based models to extract features from skeletons for performing this task, because skeleton representations are much more efficient and robust than other modalities such as RGB frames. However, when employing the skeleton data, some important clues like related items are also discarded. It results in some ambiguous actions that are hard to be distinguished and tend to be misclassified. To alleviate this problem, we propose an auxiliary feature refin…
Temporal grounding aims to localize temporal boundaries within untrimmed videos by language queries, but it faces the challenge of two types of inevitable human uncertainties: query uncertainty and label uncertainty. The two uncertainties stem from human subjectivity, leading to limited generalization ability of temporal grounding. In this work, we propose a novel DeNet (Decoupling and De-bias) to embrace human uncertainty: Decoupling - We explicitly disentangle each query into a relation feature and a modified feature. The relation feature, which is mainly based on skeleton-like words (includ…
Decoupling Wavelet Sub-bands for Single Source Domain Generalization in Fundus Image Segmentation
Indian Statistical Institute（印度统计研究所）；University of Oxford（牛津大学）；Radcliffe Department of Medicine, University of Oxford（牛津大学拉德克利夫医学系）；Department of Engineering Science, University of Oxford（牛津大学工程科学系）
SkelEM: Training-Signal Decoupling of Skeleton and Diffusion for Self-supervised Axial Super-Resolution in Volume Microscopy
School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, China（中国科学院大学先进交叉学科学院）；State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences, China（中国科学院脑认知与脑启发智能技术国家重点实验室）；School of Future Technology, University of Chinese Academy of Sciences, China（中国科学院大学未来技术学院）；School of Artificial Intelligence, University of Chinese Academy of Sciences, China（中国科学院大学人工智能学院）
Wavelet-based Decoupling Framework for low-light Stereo Image Enhancement
Shaanxi Key Laboratory for Network Computing and Security Technology（陕西网络计算与安全技术重点实验室）；School of Computer Science and Engineering（计算机科学与工程学院）；Xi'an University of Technology（西安理工大学）
All-in-One Image Restoration via Causal-Deconfounding Wavelet-Disentangled Prompt Network
University of Chinese Academy of Sciences（中国科学院大学）；Institute of Software, Chinese Academy of Science（中国科学院软件研究所）；Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系）；National Research Center for Information Science and Technology (BNRist)（国家信息科学与技术研究中心（BNRist））；Artificial Intelligence Thrust, The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）人工智能方向）
Edit-Your-Motion: Space-Time Diffusion Decoupling Learning for Video Motion Editing
Xidian University（西安电子科技大学）；School of Artificial Intelligence（人工智能学院）；Key Laboratory of Intelligent Perception and Image Understanding of the Ministry of Education of China（智能感知与图像理解教育部重点实验室）；International Research Center of Intelligent Perception and Computation（智能感知与计算国际研究中心）
The availability of low-cost range sensors and the development of relatively robust algorithms for the extraction of skeleton joint locations have inspired many researchers to develop human activity recognition methods using the 3-D data. In this paper, an effective method for the recognition of human activities from the normalized joint trajectories is proposed. We represent the actions as multidimensional signals and introduce a novel method for generating action templates by averaging the samples in a "dynamic time" sense. Then in order to deal with the variations in the speed and style of …
FDNet: Feature Decoupled Segmentation Network for Tooth CBCT Image
Hangzhou Dianzi University（杭州电子科技大学）；College of Media Engineering, Communication University of Zhejiang（浙江传媒学院媒体工程学院）；Shandong University（山东大学）；University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心）
针对牙齿 CBCT 中伪影复杂、边界模糊的问题，本文提出 FDNet，用 LF-Wavelet 增强全局语义并结合 SAM 编码器细化边界，在基准上取得最优分割性能。
