你的家记得:用于对话检索的语音驱动家庭记忆助手
Your Home Remembers: A Voice-Enabled Household Memory Assistant for Conversational Retrieval
AI总结:
提出一种运行于Android平板的语音驱动智能家居助手,采用模块化架构,通过检索增强生成实现对话式家庭信息检索,支持免提交互与时间戳来源检查。
摘要:
日常家庭信息常通过对话交流却未被记录,导致细节易被遗忘或记错。我们提出一种语音驱动的智能家居助手,作为家庭记忆,可记录对话并从存储及新捕获的语音中检索信息。该助手运行于Android平板,采用模块化架构,语音识别、说话人 diarisation(说话人分割)、嵌入及语言模型可通过编排层配置或替换。设备端唤醒词检测与基于VAD的查询捕获支持免提交互。录制音频按可配置块处理,经转录、说话人分割,转换为带对话级时间戳的轮次感知段落,存入向量存储。针对记忆查询,检索增强生成(RAG)流水线选择关键段落并据此生成答案。界面支持录制、对话管理及带时间戳来源的检查。
英文摘要:
Everyday household information is often exchanged in conversations but never written down, making details easy to forget or misremember. We present a voice-enabled smart-home assistant that acts as a household memory by recording conversations and retrieving information from stored and newly captured speech. The assistant runs on an Android tablet with a modular architecture in which speech-recognition, diarisation, embedding and language models can be configured or replaced through an orchestration layer. On-device wake-word detection and VAD-based query capture support hands-free interaction. Recorded audio is processed in configurable chunks, transcribed and diarised, converted into turn-aware passages with conversation-level timestamps, and indexed in a vector store. For memory queries, a retrieval-augmented generation pipeline selects key passages and uses them to generate an answer. The interface supports recording, conversation management and inspection of timestamped sources.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。