arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2510.06552cs.CL
收藏

翻转对话:训练和评估用户语言模型

Flipping the Dialogue: Training and Evaluating User Language Models

Microsoft Research(微软研究院);Georgia Institute of Technology(佐治亚理工学院)

Tarek Naous, Philippe Laban, Wei Xu, Jennifer Neville

AI总结:

本文提出User LMs,通过多轮对话模拟人类用户,验证其在真实场景下优于传统模拟方法,提升评估准确性。

摘要:

对话涉及人类用户和语言模型助手。传统训练使LM成为帮助者,但作为用户模拟器表现不佳。本文引入专门训练的User LMs,通过多轮对话更贴近人类行为,提升模拟鲁棒性。在编码和数学对话中,GPT-4o的性能从74.6%降至57.4%,证明更真实的模拟环境使助手难以应对多轮对话中的细微差别。

英文摘要:

Conversations with LMs involve two participants: a human user leading the conversation, and an LM assistant responding to the user's request. To satisfy this specific role, LMs are post-trained to be helpful assistants -- optimized to produce exhaustive and well-structured responses, free of ambiguity and grammar errors. User utterances, on the other hand, are rarely perfected, with each user phrasing requests in unique ways, sometimes putting in partial effort at each turn and refining on the fly. To evaluate LM performance in realistic settings, prior work simulated users in multi-turn conversations, often by prompting an LM originally trained to be a helpful assistant to act as a user. However, we show that assistant LMs make for poor user simulators, with the surprising finding that better assistants yield worse simulators. Instead, we introduce purpose-built User Language Models (User LMs) - models post-trained to simulate human users in multi-turn conversations. Through various evaluations, we show how User LMs align better with human behavior and achieve better simulation robustness than existing simulation methods. When leveraging User LMs to simulate coding and math conversations, the performance of a strong assistant (GPT-4o) drops from 74.6% to 57.4%, confirming that more realistic simulation environments lead to assistant struggles as they fail to cope with the nuances of users in multi-turn setups.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑