智能家居环境中基于传感器的日常生活活动(Activities of Daily Living, ADLs)识别可支撑能源管理、安全、福祉与医疗保健领域的多项应用。ADLs识别通常依赖深度学习方法,这类方法需要大型数据集才能完成训练。近期多项研究证明,大语言模型(Large Language Models, LLMs)能够有效捕捉关于人类活动的常识知识,但LLMs在智能家居环境ADLs识别任务中的有效性仍有待探究。本研究提出了一种新型基于LLM的ADLs识别系统ADL-LLM。该系统将原始传感器数据转换为文本表示,交由LLM处理以实现零样本ADLs识别;此外,在存在小型标注数据集的场景下,ADL-LLM还可通过少样本提示增强性能。我们在两个公开数据集上对ADL-LLM进行了评估,验证了其在该领域的有效性。
英文摘要:
The sensor-based recognition of Activities of Daily Living (ADLs) in smart home environments enables several applications in the areas of energy management, safety, well-being, and healthcare. ADLs recognition is typically based on deep learning methods requiring large datasets to be trained. Recently, several studies proved that Large Language Models (LLMs) effectively capture common-sense knowledge about human activities. However, the effectiveness of LLMs for ADLs recognition in smart home environments still deserves to be investigated. In this work, we propose ADL-LLM, a novel LLM-based ADLs recognition system. ADLLLM transforms raw sensor data into textual representations, that are processed by an LLM to perform zero-shot ADLs recognition. Moreover, in the scenario where a small labeled dataset is available, ADL-LLM can also be empowered with few-shot prompting. We evaluated ADL-LLM on two public datasets, showing its effectiveness in this domain.
Detecting Daily Living Gait Amid Huntington's Disease Chorea using a Foundation Deep Learning Model
Tel Aviv University(特拉维夫大学);Tel Aviv Sourasky Medical Center(特拉维夫苏拉斯基医疗中心);Teachers College, Columbia University(哥伦比亚大学教师学院);Wayne State University(韦恩州立大学);Stony Brook University(石溪大学);Rush University Medical Center(拉什大学医学中心)
On-Demand Myoelectric Control Using Wake Gestures to Eliminate False Activations During Activities of Daily Living
Department of Electrical Engineering, University of New Brunswick(新不伦瑞克大学电气工程学院);HCI and SPECTRAL Labs, University of New Brunswick(新不伦瑞克大学HCI与SPECTRAL实验室)
Paving the Way Towards Kinematic Assessment Using Monocular Video: A Preclinical Benchmark of State-of-the-Art Deep-Learning-Based 3D Human Pose Estimators Against Inertial Sensors in Daily Living Activities
An Efficient Data Imputation Technique for Human Activity Recognition
Instituto de Telecomunicações(电信研究所);Universidade da Beira Interior(贝拉内华大学);Polytechnic Institute of Viseu(维塞乌理工学院);Department of Computer Engineering(计算机工程系);University of Engineering and Technology (UET)(工程与技术大学);Faculty of Computer Science and Engineering(计算机科学与工程学院);University Ss Cyril and Methodius(圣西里尔与美多德大学)
A Simplistic and Cost-Effective Design for Real-World Development of an Ambient Assisted Living System for Fall Detection and Indoor Localization: Proof of Concept