In the human activity recognition research area, prior studies predominantly concentrate on leveraging advanced algorithms on public datasets to enhance recognition performance, little attention has been paid to executing real-time kitchen activity recognition on energy-efficient, cost-effective edge devices. Besides, the prevalent approach of segregating data collection and context extraction across different devices escalates power usage, latency, and user privacy risks, impeding widespread adoption. This work presents a multi-modal wearable edge computing system for human activity recognition in real-time. Integrating six different sensors, ranging from inertial measurement units (IMUs) to thermal cameras, and two different microcontrollers, this system achieves end-to-end activity recognition, from data capture to context extraction, locally. Evaluation in an unmodified realistic kitchen validates its efficacy in recognizing fifteen activities, including a null class. Employing a compact machine learning model (184.5 kbytes) yields an average accuracy of 87.83 \%, with model inference completed in 25.26 ms on the microcontroller. Comparative analysis with alternative microcontrollers showcases power consumption and inference speed performance, demonstrating the proposed system's viability.
Cuffless Blood Pressure Estimation from Six Wearable Sensor Modalities in Multi-Motion-State Scenarios
Faculty of Frontier Sciences, Harbin Institute of Technology, Shenzhen(前沿科学学院,哈尔滨工业大学深圳校区);University of Melbourne(墨尔本大学);University of New South Wales(新南威尔士大学)
Hybrid CNN-Dilated Self-attention Model Using Inertial and Body-Area Electrostatic Sensing for Gym Workout Recognition, Counting, and User Authentification
Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signals
Halıcıoğlu Data Science Institute, University of California San Diego(哈利奇奥格鲁数据科学研究所,加州大学圣地亚哥分校);Schools of Engineering, Arizona State University(工程学院,亚利桑那州立大学)
Classification of Infant Sleep/Wake States: Cross-Attention among Large Scale Pretrained Transformer Networks using Audio, ECG, and IMU Data
University of Illinois at Urbana Champaign(伊利诺伊大学厄巴纳-香槟分校);Beckman Institute for Advanced Science and Technology(贝克曼高级科学技术研究院);Worcester Polytechnic Institute(伍斯特理工学院)
PPGFlowECG: Latent Rectified Flow with Cross-Modal Encoding for PPG-Guided ECG Generation and Cardiovascular Disease Detection
National Institute of Health Data Science, Peking University, China(北京大学国家健康数据科学研究院);School of Intelligence Science and Technology, Peking University, China(北京大学智能科学与技术学院);Data Science Institute, Imperial College London, UK(伦敦帝国理工学院数据科学研究院);University of Chinese Academy of Sciences, China(中国科学院大学)