arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.01133cs.LGeess.SP
收藏

评估大型语言模型作为时间序列物理传感数据的虚拟标注器

Evaluating Large Language Models as Virtual Annotators for Time-series Physical Sensing Data

Indian Institute of Technology(印度理工学院);Nokia Bell Labs(诺基亚贝尔实验室)

Aritra Hota, Soumyajit Chatterjee, Sandip Chakraborty

AI总结:

本文评估了GPT-4等最先进的大型语言模型作为时间序列物理传感数据虚拟标注器的可行性,通过分阶段研究证明,结合自监督学习编码和度量指导可使LLM在无需微调的情况下提供准确标注。

摘要:

针对惯性数据等时间序列数据的传统人在回路标注方法,通常需要访问来自环境的视频或音频等替代模态。这些替代来源为人类标注者提供了必要的信息,因为原始数值数据通常过于晦涩,即使是专家也难以理解。然而,这种传统方法在总体成本、效率、额外模态的存储、时间、可扩展性和隐私方面存在许多问题。有趣的是,最近的大型语言模型(LLMs)也接受了大量公开可用的字母数字数据训练,这使它们能够理解并在自然语言处理之外的任务中表现出色。自然而然地,这开辟了一条探索 LLMs 作为虚拟标注器的潜在途径,即将原始传感器数据直接提供给 LLMs 进行标注,而不是依赖任何替代模态。显然,这可以缓解传统人在回路方法的问题。受此观察的启发,我们在本文中进行了一项详细的研究,以评估最先进(SOTA)的 LLMs 是否可以用作标记时间序列物理传感数据的虚拟标注器。为了以有原则的方式执行此操作,我们将研究分为两个主要阶段。在第一阶段,我们调查了像 GPT-4 这样的 LLM 在理解原始传感器数据时面临的挑战。考虑到第一阶段的观察结果,在下一阶段,我们研究了使用 SOTA SSL 方法编码原始传感器数据,并利用投影后的时间序列数据从 LLM 获取标注的可能性。使用四个基准 HAR 数据集进行的详细评估表明,基于 SSL 的编码和基于度量的指导使 LLM 能够做出更合理的决策并提供准确的标注,而无需计算成本高昂的微调或复杂的提示工程。

英文摘要:

Traditional human-in-the-loop-based annotation for time-series data like inertial data often requires access to alternate modalities like video or audio from the environment. These alternate sources provide the necessary information to the human annotator, as the raw numeric data is often too obfuscated even for an expert. However, this traditional approach has many concerns surrounding overall cost, efficiency, storage of additional modalities, time, scalability, and privacy. Interestingly, recent large language models (LLMs) are also trained with vast amounts of publicly available alphanumeric data, which allows them to comprehend and perform well on tasks beyond natural language processing. Naturally, this opens up a potential avenue to explore LLMs as virtual annotators where the LLMs will be directly provided the raw sensor data for annotation instead of relying on any alternate modality. Naturally, this could mitigate the problems of the traditional human-in-the-loop approach. Motivated by this observation, we perform a detailed study in this paper to assess whether the state-of-the-art (SOTA) LLMs can be used as virtual annotators for labeling time-series physical sensing data. To perform this in a principled manner, we segregate the study into two major phases. In the first phase, we investigate the challenges an LLM like GPT-4 faces in comprehending raw sensor data. Considering the observations from phase 1, in the next phase, we investigate the possibility of encoding the raw sensor data using SOTA SSL approaches and utilizing the projected time-series data to get annotations from the LLM. Detailed evaluation with four benchmark HAR datasets shows that SSL-based encoding and metric-based guidance allow the LLM to make more reasonable decisions and provide accurate annotations without requiring computationally expensive fine-tuning or sophisticated prompt engineering.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑