HARGPT:LLM 是零样本人类活动识别器吗?
HARGPT: Are LLMs Zero-Shot Human Activity Recognizers?
AI总结:
本文提出 HARGPT,将原始 IMU 数据输入 GPT4 并结合角色扮演与逐步思考提示,验证 LLM 可零样本识别人类活动且在两个数据集上超越传统机器学习和深度模型基线。
摘要:
关于大型语言模型(LLM)作为可与信息物理系统(CPS)无缝集成、用于解释物理世界的基础模型的潜力,目前仍存在争论。本文开展了一项案例研究,以回答以下问题:LLM 是否能够进行零样本人类活动识别(HAR)。我们的研究 HARGPT 给出了肯定答案,证明 LLM 仅借助适当的提示,就能理解原始 IMU 数据并以零样本方式执行 HAR 任务。HARGPT 将原始 IMU 数据输入 LLM,并采用角色扮演和逐步思考策略进行提示。我们在 GPT4 上使用两个具有不同类间相似度的公开数据集对 HARGPT 进行基准测试,并与多种基于传统机器学习的基线方法以及最先进的深度分类模型进行比较。值得注意的是,LLM 成功地从原始 IMU 数据中识别人类活动,并且在两个数据集上始终优于所有基线方法。研究结果表明,通过有效的提示,LLM 可以基于其知识库解释原始 IMU 数据,具备有效分析物理世界原始传感器数据的良好潜力。
英文摘要:
There is an ongoing debate regarding the potential of Large Language Models (LLMs) as foundational models seamlessly integrated with Cyber-Physical Systems (CPS) for interpreting the physical world. In this paper, we carry out a case study to answer the following question: Are LLMs capable of zero-shot human activity recognition (HAR). Our study, HARGPT, presents an affirmative answer by demonstrating that LLMs can comprehend raw IMU data and perform HAR tasks in a zero-shot manner, with only appropriate prompts. HARGPT inputs raw IMU data into LLMs and utilizes the role-play and think step-by-step strategies for prompting. We benchmark HARGPT on GPT4 using two public datasets of different inter-class similarities and compare various baselines both based on traditional machine learning and state-of-the-art deep classification models. Remarkably, LLMs successfully recognize human activities from raw IMU data and consistently outperform all the baselines on both datasets. Our findings indicate that by effective prompting, LLMs can interpret raw IMU data based on their knowledge base, possessing a promising potential to analyze raw sensor data of the physical world effectively.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。