FinBoardBench: 通过棋盘游戏模拟基准测试大语言模型的动态财富管理和战略金融推理
FinBoardBench: Benchmarking Dynamic Wealth Management and Strategic Financial Reasoning of LLMs via Board Game Simulations
浏览论文内容
中文总结 AI 辅助
提出基于三款经典金融棋盘游戏的评估套件FinBoardBench，测试大语言模型在动态财富管理、企业投资收购和竞争谈判等综合金融技能，发现模型虽具备基本规划能力但无法将静态推理转化为成功动态决策。
中文摘要 AI 辅助
近期，大语言模型（LLMs）在静态金融推理和简单动态交易任务中取得了优越性能。然而，现有的静态金融基准不足以评估LLMs在真实环境中的动态财富管理和金融决策能力。为弥补这一差距，我们提出了FinBoardBench，一个基于三款经典金融棋盘游戏（现金流、并购和大富翁）的评估套件。FinBoardBench评估一系列全面的金融技能，包括个人现金流管理与债务平衡、企业投资与收购预测，以及带有资产拍卖的竞争性贸易谈判。我们对9个先进LLMs的实验表明，尽管它们展现出基本的长期规划和投资逻辑，但未能有效利用复杂互动来获取利润，且其强大的静态推理性能并未转化为成功的动态决策。值得注意的是，它们倾向于优先获取即时资产而非维持充足流动性，这使得它们容易受到随机事件引发的金融危机的影响。我们希望FinBoardBench能为未来更智能的基于LLM的决策系统提供有价值的参考。
英文摘要
Recently, large language models (LLMs) have achieved superior performance in static financial reasoning and simple dynamic trading tasks. However, existing static financial benchmarks are insufficient to assess the dynamic wealth management and financial decision-making capabilities of LLMs in real-world environments. To bridge this gap, we present FinBoardBench, an evaluation suite based on three classic financial board games: Cashflow, Acquire, and Monopoly. FinBoardBench assesses a comprehensive set of financial skills, including personal cash flow management with debt balancing, corporate investment and acquisition forecasting, and competitive trade negotiations with asset auctions. Our experiments with 9 advanced LLMs reveal that while exhibiting basic long-term planning and investment logic, they fail to effectively leverage complex interactions for profit, and their strong static reasoning performance does not transform into successful dynamic decision-making. Notably, they tend to prioritize immediate asset acquisition over maintaining sufficient liquidity, making them vulnerable to financial crises triggered by random events. We hope that FinBoardBench can provide a valuable reference for more intelligent LLM-based decision-making systems in the future.
发表机构
- School of Computer Science and Engineering, Macau University of Science and Technology, Macau, China（1 计算机科学与工程学院，澳门科技大学，澳门，中国）
- School of Economics, Anhui University, Anhui, China（2 经济学院，安徽大学，安徽，中国）
- SKLPlanets, Macau University of Science and Technology, Macau, China（3 SKLPlanets，澳门科技大学，澳门，中国）
- Department of Computer and Information Science, University of Macau, Macau, China（4 计算机与信息科学系，澳门大学，澳门，中国）
- School of Energy and Power Engineering, Huazhong University of Science and Technology, Hubei, China（5 能源与动力工程学院，华中科技大学，湖北，中国）
机构由 AI 辅助整理，请以论文原文为准。
