arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2511.00993cs.AIcs.LG
收藏

对齐 LLM 智能体与人类学习和调整行为:一种双智能体方法

Aligning LLM agents with human learning and adjustment behavior: a dual agent approach

Department of Civil and Environmental Engineering, University of Michigan, Ann Arbor, United States(美国密歇根大学土木与环境工程系);Department of Electrical Engineering and Computer Science, University of Michigan, Ann Arbor, United States(美国密歇根大学电气工程与计算机科学系);College of Civil Engineering and Architecture, Zhejiang University, Hangzhou, China(浙江大学建筑工程学院)

Tianming Liu, Jirong Yang, Yafeng Yin, Manzi Li, Linghao Wang, Zheng Zhu

AI总结:

提出一种双智能体框架,通过配备记忆和可学习人设的LLM出行者智能体与LLM校准智能体协同,实现对人类出行者学习和适应行为的持续对齐与真实模拟。

摘要:

有效建模人类出行者如何通过与交通系统交互来学习和调整出行行为,对于系统评估和规划至关重要。然而,由于此类行为涉及复杂的认知和决策,该任务也充满挑战。近期研究已开始利用大型语言模型(LLM)智能体来完成此任务。在此基础上,我们引入了一种新颖的双智能体框架,该框架利用在线数据流实现 LLM 智能体与人类出行者在学习和适应行为上的持续学习与对齐。我们的方法包含一组配备了记忆系统和可学习人设的 LLM 出行者智能体,它们作为人类出行者的模拟器。为确保行为对齐,我们引入了一个 LLM 校准智能体,它利用 LLM 的推理和分析能力来训练这些出行者智能体的人设。协同工作时,这个双智能体系统旨在追踪并对齐出行者潜在的决策机制,从而产生真实、自适应的模拟。使用来自逐日路线选择实验的真实世界数据集,我们表明我们的方法在个体行为对齐和总体模拟准确性上均显著优于现有的基于 LLM 的方法。此外,我们证明我们的方法超越了简单的行为模仿,能够捕捉潜在学习过程的演变,这种更深层次的对齐促进了稳健的泛化。总体而言,我们的框架提供了一种新方法,用于创建自适应且行为真实的智能体来模拟出行者的学习和适应,这有益于交通模拟和政策分析。

英文摘要:

Effective modeling of how human travelers learn and adjust their travel behavior from interacting with transportation systems is critical for system assessment and planning. However, this task is also difficult due to the complex cognition and decision-making involved in such behavior. Recent research has begun to leverage Large Language Model (LLM) agents for this task. Building on this, we introduce a novel dual-agent framework that enables continuous learning and alignment between LLM agents and human travelers on learning and adaptation behavior from online data streams. Our approach involves a set of LLM traveler agents, equipped with a memory system and a learnable persona, which serve as simulators for human travelers. To ensure behavioral alignment, we introduce an LLM calibration agent that leverages the reasoning and analytical capabilities of LLMs to train the personas of these traveler agents. Working together, this dual-agent system is designed to track and align the underlying decision-making mechanisms of travelers and produce realistic, adaptive simulations. Using a real-world dataset from a day-to-day route choice experiment, we show our approach significantly outperforms existing LLM-based methods in both individual behavioral alignment and aggregate simulation accuracy. Furthermore, we demonstrate that our method moves beyond simple behavioral mimicry to capture the evolution of underlying learning processes, a deeper alignment that fosters robust generalization. Overall, our framework provides a new approach for creating adaptive and behaviorally realistic agents to simulate travelers' learning and adaptation that can benefit transportation simulation and policy analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑