Low-resolution infrared (IR) array sensors offer a low-cost, low-power, and privacy-preserving alternative to optical cameras and smartphones/wearables for social distance monitoring in indoor spaces, permitting the recognition of basic shapes, without revealing the personal details of individuals. In this work, we demonstrate that an accurate detection of social distance violations can be achieved processing the raw output of a 8x8 IR array sensor with a small-sized Convolutional Neural Network (CNN). Furthermore, the CNN can be executed directly on a Microcontroller (MCU)-based sensor node.
With results on a newly collected open dataset, we show that our best CNN achieves 86.3% balanced accuracy, significantly outperforming the 61% achieved by a state-of-the-art deterministic algorithm. Changing the architectural parameters of the CNN, we obtain a rich Pareto set of models, spanning 70.5-86.3% accuracy and 0.18-75k parameters. Deployed on a STM32L476RG MCU, these models have a latency of 0.73-5.33ms, with an energy consumption per inference of 9.38-68.57μJ.
Real-Time Stress Detection via Photoplethysmogram Signals: Implementation of a Combined Continuous Wavelet Transform and Convolutional Neural Network on Resource-Constrained Microcontrollers
University of Tehran(德黑兰大学);Kettering University(凯特林大学)
FEMBA on the Edge: Physiologically-Aware Pre-Training, Quantization, and Deployment of a Bidirectional Mamba EEG Foundation Model on an Ultra-low Power Microcontroller
Integrated Systems Laboratory, ETH Zürich(苏黎世联邦理工学院集成系统实验室);DEI, University of Bologna(博洛尼亚大学电气、电子与信息工程系)
PolyChirp: Multi-Species Birdsong Classification Using TinyML on Low-Power Acoustic Sensors
École Polytechnique(巴黎综合理工学院);Freie Universität Berlin(柏林自由大学);Berlin University of Applied Sciences (BHT)(柏林应用科技大学);HES-SO Valais-Wallis(瓦莱州瓦利斯高等专业学院);Inria(法国国家信息与自动化研究所)
Towards Family-Grouped Hierarchical Federated Learning on Sub-5KB Models: A Feasibility Study of Privacy-Preserving ECG Monitoring for Ultra-Resource-Constrained Wearables
Connect the Dots: In Situ 4D Seismic Monitoring of CO2 Storage with Spatio-temporal CNNs
Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室);Michigan State University(密歇根州立大学)
4D震波成像已被广泛用于CO $_2$封存项目,以监测未通过井采样的体积地下区域中的流体流动。理想情况下,实时监测和近期预测将为现场运营商提供深刻的见解,以了解地下储层的动态并评估任何潜在风险。然而,由于诸如高部署成本、采集设备的可用性、表面结构周围的禁区等障碍,在监测期间只能获得非常稀疏的震波成像数据。随着时间的推移,这导致了不可避免的和不断扩大的知识差距。运营商需要了解整个项目生命周期内的流体流动,而地震资料只能在有限的时间内获得。这对于理解储层动态是不够的。为了克服这些挑战,我们开发了基于时空神经网络的模型,可以有效和高效地产生高保真的内插或外推图像。具体来说,我们的模型建立在自动编码器上,并将长短期记忆(LSTM)结构与光流正则化的新损失函数相结合。我们验证我们的模型使用真实的4D叠后震波成像数据获得的Sleipner CO $_2$封存领域的性能。我们采用两种不同的策略来评估我们的模型。在数值上,我们使用经典的基于像素的指标将我们的模型与不同的基线方法进行比较。我们还进行了一项盲测,并从领域专家那里收集了总共20份回复,以评估我们的模型生成的数据质量。通过数值和专家评估,我们得出结论,我们的模型可以产生高质量的二维/三维震波成像数据在一个合理的成本,提供了实时监测,甚至不久的将来预测的CO $_2$存储水库的可能性。
Towards Scalable Insect Monitoring: Ultra-Lightweight CNNs as On-Device Triggers for Insect Camera Traps
University of Exeter(埃克塞特大学);Institute for Data Science and AI, University of Exeter(埃克塞特大学数据科学与人工智能学院);Centre for Ecology and Conservation, University of Exeter(埃克塞特大学生态与保护中心)
针对 PIR 传感器难以触发昆虫相机陷阱的问题,本文提出在低功耗微控制器上运行超轻量级 CNN 检测连续图像中的昆虫,实现零延迟、高 AUC、低功耗与更长部署。
Multiple Patients Behavior Detection in Real-time using mmWave Radar and Deep CNNs
The University of Arizona(亚利桑那大学);Banner - University Medical Center Phoenix(班纳大学医学中心凤凰城分中心);Department of Electrical and Computer Engineering The University of Arizona(亚利桑那大学电气与计算机工程系);Department of Medicine Banner - University Medical Center Phoenix(班纳大学医学中心凤凰城分中心医学部)
Queen Detection in Beehives via Environmental Sensor Fusion for Low-Power Edge Computing
Institute of Neuroinformatics University of Zurich and ETH Zurich(神经信息学研究所(苏黎世大学和苏黎世联邦理工学院));Digital Society Initiative University of Zurich(数字社会倡议(苏黎世大学))