arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.04974cs.CLcs.AI
收藏

SensorQA:面向日常生活监测的问答基准

SensorQA: A Question Answering Benchmark for Daily-Life Monitoring

Georgia Institute of Technology(佐治亚理工学院);University of California San Diego(加利福尼亚大学圣迭戈分校)

Benjamin Reichman, Xiaofan Yu, Lanxiang Hu, Jack Truxal, Atishay Jain, Rushil Chandrupatla, Tajana Šimunić Rosing, Larry Heck

AI总结:

本文提出首个面向日常生活监测的长期时间序列传感器数据人工创建问答数据集 SensorQA,包含 5.6K 个查询,并基于此为最先进 AI 模型建立基准,评估其在边缘设备上的性能,揭示了当前模型与最佳 QA 性能和效率之间的差距。

摘要:

随着传感器数据的快速增长,以人类易于理解的方式有效地解释和交互这些数据变得至关重要。虽然现有研究主要集中在学习分类模型上,但探索终端用户如何主动从传感器数据中提取有用见解的研究较少,这往往因缺乏合适的数据集而受阻。为了填补这一空白,我们引入了 SensorQA,这是首个用于日常生活监测的长期时间序列传感器数据的人工创建问答(QA)数据集。SensorQA 由人工工作者创建,包含 5.6K 个反映真实人类兴趣的多样且实用的查询,并配有从传感器数据中得出的准确答案。我们进一步在此数据集上为最先进的 AI 模型建立了基准,并评估了它们在典型边缘设备上的性能。我们的结果揭示了当前模型与最佳 QA 性能和效率之间的差距,凸显了新贡献的需求。数据集和代码可在 https://github.com/benjamin-reichman/SensorQA 获取。

英文摘要:

With the rapid growth in sensor data, effectively interpreting and interfacing with these data in a human-understandable way has become crucial. While existing research primarily focuses on learning classification models, fewer studies have explored how end users can actively extract useful insights from sensor data, often hindered by the lack of a proper dataset. To address this gap, we introduce SensorQA, the first human-created question-answering (QA) dataset for long-term time-series sensor data for daily life monitoring. SensorQA is created by human workers and includes 5.6K diverse and practical queries that reflect genuine human interests, paired with accurate answers derived from sensor data. We further establish benchmarks for state-of-the-art AI models on this dataset and evaluate their performance on typical edge devices. Our results reveal a gap between current models and optimal QA performance and efficiency, highlighting the need for new contributions. The dataset and code are available at: https://github.com/benjamin-reichman/SensorQA.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑