arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.01059cs.CL
收藏

GroupGPT: 一种高效且隐私保护的多用户聊天助手代理框架

GroupGPT: A Token-efficient and Privacy-preserving Agentic Framework for Multi-User Chat Assistant

East China Normal University(华东师范大学);University of Nottingham Ningbo(宁波诺丁汉大学);Xiamen University(厦门大学)

Zhuokang Shen, Yifan Wang, Hanyu Chen, Yunhang Shen, Wenxuan Huang, Gaoqi He, Jiao Xie, Rongrong Ji, Shaohui Lin

AI总结:

GroupGPT通过边缘-云协作架构实现高效决策,支持多模态输入,减少token使用并保护隐私,通过MUIR基准测试验证其准确性和用户接受度。

摘要:

近期大型语言模型(LLMs)的进步使聊天机器人能力不断提升。然而,现有系统大多针对单用户场景,难以适应多用户群组聊天交互,其中代理需在复杂动态上下文中更主动和准确地干预。现有方法通常依赖LLMs进行干预推理和响应生成,导致高token消耗、扩展性差和隐私风险。为解决这些问题,我们提出了GroupGPT,一种高效且隐私保护的多用户聊天助手代理框架。GroupGPT采用边缘-云模型协作架构,将干预时机与响应生成分离,实现高效准确的决策同时通过设备端处理敏感信息保护用户隐私。该框架还支持多模态输入,包括表情包、图片、视频和语音信息。为评估干预准确性和响应质量,我们进一步引入MUIR,一个多用户聊天助手干预推理基准数据集。MUIR包含2500个标注的群组聊天片段,包含干预标签和理由。我们评估了多种模型在MUIR上的表现,涵盖从开源到专有变体,包括LLMs及其小型版本。大量实验表明,GroupGPT生成准确且适时的响应,在LLM基础上评估中获得4.72/5.0的平均分,并在多样化的群组聊天场景中受到用户好评。此外,GroupGPT相比基线减少了多达3倍的token使用,同时在云传输前对用户消息提供隐私清理。代码可在:https://github.com/Eliot-Shen/GroupGPT 获取。

英文摘要:

Recent advances in large language models (LLMs) have enabled increasingly capable chatbots. However, most existing systems focus on single-user settings and do not generalize well to multi-user group chat interactions, where agents require more proactive and accurate intervention under complex, evolving contexts. Existing approaches typically rely on LLMs for both intervention reasoning and response generation, leading to high token consumption, limited scalability, and potential privacy risks. To address these challenges, we propose GroupGPT, a token-efficient and privacy-preserving agentic framework for multi-user chat assistant. GroupGPT adopts an edge-cloud model collaboration architecture to decouple intervention timing from response generation, enabling efficient and accurate decision-making while preserving user privacy through on-device processing of sensitive information. The framework also supports multimodal inputs, including memes, images, videos, and voice messages.To support evaluation of timing accuracy and response quality, we further introduce MUIR, a benchmark dataset for multi-user chat assistant intervention reasoning. MUIR contains 2,500 annotated group chat segments with intervention labels and rationales. We evaluate a range of models on MUIR, spanning from open-source to proprietary variants, including both LLMs and their smaller counterparts. Extensive experiments demonstrate that GroupGPT generates accurate and well-timed responses, achieving an average score of 4.72/5.0 in LLM-based evaluation, and is well-received by users across diverse group chat scenarios. Moreover, GroupGPT reduces the token usage by up to 3 times compared to baselines, while providing privacy sanitization of user messages before cloud transmission. Code is available at: https://github.com/Eliot-Shen/GroupGPT .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑