发表机构
Anhui University; National Institute of Informatics(安徽大学; 信息学研究所)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
Bio-MemArt提出一种生物特征感知的KV缓存内存框架,通过为内存块附加生物特征模板并过滤共享池,为多用户LLM智能体添加物理用户访问控制,同时保持高效检索与低令牌开销。
AI 中文摘要
KV缓存正从一种服务优化手段演变为长期LLM智能体的外部内存基底。然而,在共享的多用户部署中,可复用的KV块引入了一个缺失的访问控制问题:仅凭语义相关性无法确定某个内存块是否被授权给当前物理用户。我们提出了Bio-MemArt,一种面向多用户LLM智能体的生物特征感知KV缓存内存框架。Bio-MemArt为每个存储的KV内存块附加一个归一化的生物特征模板,使用当前用户的生物特征探针过滤共享内存池,然后仅在授权的候选池内运行原始的MemArt检索和KV复用流水线。该设计在保留潜在空间检索、直接缓存复用和解耦位置编码的同时,为共享KV内存添加了物理用户访问控制。我们在长期对话问答中,使用人脸和掌纹基准,在所有者(Owner)和非所有者(Non-owner)查询条件下评估了Bio-MemArt。在人脸基准上,所有者和非所有者的平均生物特征成功率分别为95.71%和0.86%;在掌纹基准上,分别为97.60%和2.00%。在效率研究中,平均预填充令牌数从全上下文提示下的18,781.96降至使用Bio-MemArt时的28.57,表明生物特征门控保持了KV缓存内存的低令牌运行模式。
英文摘要
KV cache is evolving from a serving optimization into an external memory substrate for long-term LLM agents. In a shared multi-user deployment, however, reusable KV blocks introduce a missing access-control question: semantic relevance alone cannot determine whether a memory block is authorized for the current physical user. We propose Bio-MemArt, a biometric-aware KV-cache memory framework for multi-user LLM agents. Bio-MemArt attaches a normalized biometric template to each stored KV memory block, filters the shared memory pool with the current user's biometric probe, and then runs the original MemArt retrieval and KV reuse pipeline only inside the authorized candidate pool. This design preserves latent-space retrieval, direct cache reuse, and decoupled position encoding while adding physical-user access control to shared KV memory. We evaluate Bio-MemArt under Owner and Non-owner query conditions on long-term dialogue QA with face and palmprint benchmarks. Across face benchmarks, the average owner and non-owner biometric success rates are 95.71% and 0.86%; across palmprint benchmarks, they are 97.60% and 2.00%. In the efficiency study, average prefill tokens drop from 18,781.96 under full-context prompting to 28.57 with Bio-MemArt, showing that biometric gating preserves the low-token operating regime of KV-cache memory.