The demand for accurate on-device pattern recognition in edge applications is intensifying, yet existing approaches struggle to reconcile accuracy with computational constraints. To address this challenge, a resource-aware hierarchical network based on multi-spectral fusion and interpretable modules, namely the Hierarchical Parallel Pseudo-image Enhancement Fusion Network (HPPI-Net), is proposed for real-time, on-device Human Activity Recognition (HAR). Deployed on an ARM Cortex-M4 microcontroller for low-power real-time inference, HPPI-Net achieves 96.70% accuracy while utilizing only 22.3 KiB of RAM and 439.5 KiB of ROM after optimization. HPPI-Net employs a two-layer architecture. The first layer extracts preliminary features using Fast Fourier Transform (FFT) spectrograms, while the second layer selectively activates either a dedicated module for stationary activity recognition or a parallel LSTM-MobileNet network (PLMN) for dynamic states. PLMN fuses FFT, Wavelet, and Gabor spectrograms through three parallel LSTM encoders and refines the concatenated features using Efficient Channel Attention (ECA) and Depthwise Separable Convolution (DSC), thereby offering channel-level interpretability while substantially reducing multiply-accumulate operations. Compared with MobileNetV3, HPPI-Net improves accuracy by 1.22% and reduces RAM usage by 71.2% and ROM usage by 42.1%. These results demonstrate that HPPI-Net achieves a favorable accuracy-efficiency trade-off and provides explainable predictions, establishing a practical solution for wearable, industrial, and smart home HAR on memory-constrained edge platforms.
Infrared and Visible Image Fusion with Hierarchical Human Perception
School of Electronic Engineering, Xidian University(西安电子科技大学电子工程学院);Key Laboratory of Image Cognition, Chongqing University of Posts and Telecommunications(重庆邮电大学图像认知重点实验室)
Little Strokes Fell Great Oaks: Boosting the Hierarchical Features for Multi-exposure Image Fusion
College of Computer Science and Technology, Zhejiang University of Technology(浙江工业大学计算机科学与技术学院);School of Mechanical Engineering, Dalian University of Technology(大连理工大学机械工程学院)
Hierarchical Semantic-Visual Fusion of Visible and Near-infrared Images for Long-range Haze Removal
National Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(多光谱信息智能处理技术国家实验室,人工智能与自动化学院,华中科技大学);State Key Laboratory of Dynamic Optical Imaging and Measurement(动态光学成像与测量国家重点实验室)
IT-TextFusion: Iterative Text-Image Interaction with Text-Guided Residual Refinement for Degradation-Aware Image Fusion
School of Automation, Southeast University(东南大学自动化学院);Chair of Robotics, Artificial Intelligence and Real-time Systems, Technical University of Munich(慕尼黑工业大学机器人、人工智能与实时系统研究所)
Image Fusion and Re-Modified SPIHT for Fused Image
本文提出了基于离散小波的融合技术,结合感知重要的图像特征。SPIHT(Set Partitioning in Hierarchical Trees)算法是一种有效的融合图像无损和有损编码方法。本文对SPIHT算法作了一些改进。该方法基于中高频子带间小波系数相关性不显著的思想。在RE-MSPIHT算法中,小波系数在SPIHT编码之前根据子带重要性进行缩放,目标是最小化MSE。
Think Hierarchically, Act Dynamically: Hierarchical Multi-modal Fusion and Reasoning for Vision-and-Language Navigation
City University of Hong Kong, Dongguan Campus(香港城市大学东莞校区);The University of Melbourne(墨尔本大学);Tsinghua University(清华大学);Baidu Inc.(百度公司);University of Chinese Academy of Science(中国科学院大学);National University of Singapore(新加坡国立大学)
Hierarchical Modeling for Medical Visual Question Answering with Cross-Attention Fusion
School of Artificial Intelligence, Tiangong University(天津工业大学人工智能学院);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Linying Medical Technology (Shenzhen) Co., Ltd.(临影医疗科技(深圳)有限公司)
MMF: Multi-Task Multi-Structure Fusion for Hierarchical Image Classification
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
CLFTv2: Efficient Camera-LiDAR Fusion for Semantic Segmentation via Hierarchical Feature Pyramids
Tallinn University of Technology(塔林理工大学);FinEst Centre for Smart Cities, Tallinn University of Technology(塔林理工大学芬埃斯特智慧城市中心);Universitas Mercatorum(梅尔卡托鲁姆大学)
DashFusion: Dual-stream Alignment with Hierarchical Bottleneck Fusion for Multimodal Sentiment Analysis
School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Beijing National Research Center for Information Science and Technology, Tsinghua University(清华大学信息科学与技术国家研究中心);Department of Automation, Tsinghua University(清华大学自动化系)
NeuroAlign: Hierarchical Multimodal Fusion of Dynamic and Structural Neuroimaging for MCI Analysis
Department of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳)计算机科学与技术学院);School of Intelligence Science and Engineering, College of Artificial Intelligence, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)人工智能学院智能科学与工程学院);School of Artificial Intelligence, Beijing University of Posts and Telecommunications(北京邮电大学人工智能学院);Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging, School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University(深圳大学医学部生物医学工程学院广东省生物医学测量与超声成像重点实验室);Department of Radiology, The People’s Hospital of Guangxi Zhuang Autonomous Region, Guangxi Academy of Medical Sciences(广西壮族自治区人民医院放射科,广西医学科学院);Shenzhen Sixth People’s Hospital (Nanshan Hospital), Huazhong University of Science and Technology Union Shenzhen Hospital(华中科技大学协和深圳医院(深圳市第六人民医院));School of Basic Medical Sciences, Shenzhen University(深圳大学基础医学院);Egypt-Japan University of Science and Technology (E-JUST)(埃及日本科技大学);School of Biomedical Engineering, National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, Shenzhen University Medical School(深圳大学医学部生物医学工程学院,国家地方联合医学超声关键技术工程实验室,广东省生物医学测量与超声成像重点实验室)
P$^2$HCT: Plug-and-Play Hierarchical C2F Transformer for Multi-Scale Feature Fusion
Department of Automation Tsinghua University Beijing, China;Department of R\&D Linsulabs Chengdu, China;School of Information;Communication Engineering University of Electronic Science
A Cross-Hierarchical Difference Feature Fusion Network Based on Multiscale Encoder-Decoder for Hyperspectral Change Detection
School of Information and Communication Engineering, Hainan University(海南大学信息与通信工程学院);Department of Artificial Intelligence, School of Information and Communication Engineering, Hainan University(海南大学信息与通信工程学院人工智能系);Department of Management Information Systems, King Faisal University(国王法赫德大学管理信息系统系)
AdaMHF: Adaptive Multimodal Hierarchical Fusion for Survival Prediction
School of Computing and Information Technology, Great Bay University(大湾区大学计算与信息技术学院);Harbin Institute of Technology(哈尔滨工业大学);Beihang University(北京航空航天大学);Macao Polytechnic University(澳门理工大学);Dongguan Key Laboratory for Intelligence and Information Technology(东莞市智能与信息技术重点实验室);Shenzhen Key Laboratory of Visual Object Detection and Recognition, Harbin Institute of Technology Shenzhen(哈尔滨工业大学深圳校区深圳市视觉目标检测与识别重点实验室)
Butter: Frequency Consistency and Hierarchical Fusion for Autonomous Driving Object Detection
Tsinghua University(清华大学);University of Chinese Academy of Sciences(中国科学院大学);Southeast University(东南大学);University of Liverpool(利物浦大学);Beijing Institute of Technology(北京理工大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Cross-Modal Binary Attention: An Energy-Efficient Fusion Framework for Audio-Visual Learning
Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School(图林根工业大学和汉诺威医学院医学信息学研究所);Lower Saxony Center for AI and Causal Methods in Medicine (CAIMed)(下萨克森人工智能与因果医学方法中心)
CoGeoAD: Hierarchical Color-Geometric Fusion with Multi-View Attention for Zero-Shot 3D Anomaly Detection
State Key Laboratory of Opto-Electronic Information Acquisition;Protection Technology, Anhui University, Hefei, China;School of Artificial Intelligence, Anhui University, Hefei, China;College of Intelligence Science;Technology, National University of Defense Technology, Changsha, China;School of Mathematics \& Physics, Anhui Jianzhu University, Hefei, China
Multimodal Information Fusion for Glaucoma and DR Classification
Inserm(法国国家健康与医学研究院);University of Western Brittany(西布列塔尼大学);IMT Atlantique(大西洋国立高等工业技术学院);Rothschild Foundation Hospital(罗斯柴尔德基金会医院);Carl Zeiss Meditec Inc(卡尔蔡司医疗科技公司);Lariboisière Hospital(拉里博瓦西耶医院);CHRU Brest(布雷斯特大学中心医院)
G2HFNet: GeoGran-Aware Hierarchical Feature Fusion Network for Salient Object Detection in Optical Remote Sensing Images
School of Control Science and Engineering, Shandong University(控制科学与工程学院,山东大学);State Key Laboratory of Autonomous Intelligent Unmanned Systems(自主智能无人系统国家重点实验室);School of Automation, Hangzhou Dianzi University(自动化学院,杭州电子科技大学);School of information engineering, Huzhou University(信息工程学院,湖州大学);School of Data Science, Lingnan University(数据科学学院,岭南大学)