arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2610.30895cs.HC
收藏

你的家记得:用于对话检索的语音驱动家庭记忆助手

Your Home Remembers: A Voice-Enabled Household Memory Assistant for Conversational Retrieval

Telefónica Innovación Digital(西班牙电信创新数字);Universitat Politècnica de Catalunya(加泰罗尼亚理工大学);Universidad Autónoma de Madrid(马德里自治大学)

Aleix Sant, Jordi Luque, Fernando López, Pablo Gómez, Carlos Escolano

AI总结:

提出一种运行于Android平板的语音驱动智能家居助手,采用模块化架构,通过检索增强生成实现对话式家庭信息检索,支持免提交互与时间戳来源检查。

摘要:

日常家庭信息常通过对话交流却未被记录,导致细节易被遗忘或记错。我们提出一种语音驱动的智能家居助手,作为家庭记忆,可记录对话并从存储及新捕获的语音中检索信息。该助手运行于Android平板,采用模块化架构,语音识别、说话人 diarisation(说话人分割)、嵌入及语言模型可通过编排层配置或替换。设备端唤醒词检测与基于VAD的查询捕获支持免提交互。录制音频按可配置块处理,经转录、说话人分割,转换为带对话级时间戳的轮次感知段落,存入向量存储。针对记忆查询,检索增强生成(RAG)流水线选择关键段落并据此生成答案。界面支持录制、对话管理及带时间戳来源的检查。

英文摘要:

Everyday household information is often exchanged in conversations but never written down, making details easy to forget or misremember. We present a voice-enabled smart-home assistant that acts as a household memory by recording conversations and retrieving information from stored and newly captured speech. The assistant runs on an Android tablet with a modular architecture in which speech-recognition, diarisation, embedding and language models can be configured or replaced through an orchestration layer. On-device wake-word detection and VAD-based query capture support hands-free interaction. Recorded audio is processed in configurable chunks, transcribed and diarised, converted into turn-aware passages with conversation-level timestamps, and indexed in a vector store. For memory queries, a retrieval-augmented generation pipeline selects key passages and uses them to generate an answer. The interface supports recording, conversation management and inspection of timestamped sources.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑