arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.02072cs.HCcs.AI
收藏

认知假体:一种基于AI的多模态系统,用于知识工作中的事件回忆

Cognitive Prosthetic: An AI-Enabled Multimodal System for Episodic Recall in Knowledge Work

Old Dominion University(老奥 Dominion 大学)

Lawrence Obiuwevwi, Krzysztof J. Rechowicz, Vikas Ashok, Sachin Shetty, Sampath Jayarathna

AI总结:

本文提出了一种基于AI的多模态系统CPMS,通过结构化事件捕获和自然语言检索,支持知识工作中的事件回忆,同时保障隐私安全。

摘要:

现代知识工作场所中,个体在面对碎片化注意力、重叠会议和多模态信息流时,对事件记忆的压力日益增加。现有的工作场所工具仅通过笔记记录或分析提供部分支持,但很少将认知、生理和注意力上下文整合到可检索的记忆表示中。本文提出了认知假体多模态系统(CPMS)——一个基于AI的原型系统,旨在通过结构化的事件捕获和自然语言检索来支持知识工作中的事件回忆。CPMS将语音转录、生理信号和注视行为同步到时间对齐的JSON基于事件记录中,并在本地处理以确保隐私。除了数据记录外,该系统还包括一个基于网页的检索界面,允许用户通过自然语言查询过去的工作经验,引用语义内容、时间、注意力焦点或生理状态。我们展示了CPMS作为一个功能原型,证明了将异构传感器数据转换为可查询事件记忆的技术可行性。该系统设计为模块化,支持部分传感器配置的操作,并集成了隐私保护措施以用于工作场所部署。本工作贡献了一个端到端、隐私友好的架构,用于基于AI的记忆增强在工作场所中的应用。

英文摘要:

Modern knowledge workplaces increasingly strain human episodic memory as individuals navigate fragmented attention, overlapping meetings, and multimodal information streams. Existing workplace tools provide partial support through note-taking or analytics but rarely integrate cognitive, physiological, and attentional context into retrievable memory representations. This paper presents the Cognitive Prosthetic Multimodal System (CPMS) --an AI-enabled proof-of-concept designed to support episodic recall in knowledge work through structured episodic capture and natural language retrieval. CPMS synchronizes speech transcripts, physiological signals, and gaze behavior into temporally aligned, JSON-based episodic records processed locally for privacy. Beyond data logging, the system includes a web-based retrieval interface that allows users to query past workplace experiences using natural language, referencing semantic content, time, attentional focus, or physiological state. We present CPMS as a functional proof-of-concept demonstrating the technical feasibility of transforming heterogeneous sensor data into queryable episodic memories. The system is designed to be modular, supporting operation with partial sensor configurations, and incorporates privacy safeguards for workplace deployment. This work contributes an end-to-end, privacy-aware architecture for AI-enabled memory augmentation in workplace settings.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑