arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2511.12876cs.AIecon.GNq-fin.EC
收藏

思考、表达、决定:语言增强的多智能体强化学习用于经济决策

Think, Speak, Decide: Language-Augmented Multi-Agent Reinforcement Learning for Economic Decision-Making

Heyang Ma, Qirui Mi, Qipeng Yang, Zijun Fan, Bo Li, Haifeng Zhang

AI总结:

本文提出LAMP框架,通过思考、表达、决定三阶段整合语言信息,提升经济决策的效率与鲁棒性,实验显示其在累积收益和可解释性上优于传统方法。

摘要:

经济决策不仅依赖于结构化信号如价格和税收,还依赖于非结构化语言,包括同行对话和媒体叙事。尽管多智能体强化学习(MARL)在优化经济决策方面显示出潜力,但其在语言的语义模糊性和上下文丰富性方面存在困难。我们提出了LAMP(语言增强多智能体策略),一个将语言整合到经济决策中的框架,缩小了与现实世界设定之间的差距。LAMP遵循一个Think-Speak-Decide流程:(1)Think解释数值观察以提取短期冲击和长期趋势,缓存高价值的推理轨迹;(2)Speak基于推理构建和交换战略性信息,通过解析同行通信更新信念;(3)Decide将数值数据、推理和反思融合到MARL策略中,以优化语言增强的决策。经济模拟实验表明,LAMP在累积收益(+63.5%,+34.0%)、鲁棒性(+18.8%,+59.4%)和可解释性方面均优于MARL和仅LLM的基线。这些结果展示了语言增强策略在实现更有效和鲁棒经济策略方面的潜力。

英文摘要:

Economic decision-making depends not only on structured signals such as prices and taxes, but also on unstructured language, including peer dialogue and media narratives. While multi-agent reinforcement learning (MARL) has shown promise in optimizing economic decisions, it struggles with the semantic ambiguity and contextual richness of language. We propose LAMP (Language-Augmented Multi-Agent Policy), a framework that integrates language into economic decision-making and narrows the gap to real-world settings. LAMP follows a Think-Speak-Decide pipeline: (1) Think interprets numerical observations to extract short-term shocks and long-term trends, caching high-value reasoning trajectories; (2) Speak crafts and exchanges strategic messages based on reasoning, updating beliefs by parsing peer communications; and (3) Decide fuses numerical data, reasoning, and reflections into a MARL policy to optimize language-augmented decision-making. Experiments in economic simulation show that LAMP outperforms both MARL and LLM-only baselines in cumulative return (+63.5%, +34.0%), robustness (+18.8%, +59.4%), and interpretability. These results demonstrate the potential of language-augmented policies to deliver more effective and robust economic strategies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑