Crisis-Bench: 大型语言模型中战略模糊与声誉管理的基准测试
Crisis-Bench: Benchmarking Strategic Ambiguity and Reputation Management in Large Language Models
AI总结：
Crisis-Bench通过多智能体POMDP评估LLM在高风险企业危机中的战略模糊与声誉管理能力，揭示模型在信息隐瞒与道德约束间的平衡问题。
摘要：
标准的安全对齐优化大型语言模型（LLMs）以实现普遍的有用性和诚实性，有效灌输了一种僵化的'男孩淑士'道德。尽管在一般用途助手方面表现稳健，这种一刀切的伦理框架对需要战略模糊和信息隐瞒的专业领域施加了'透明税'，如公共关系、谈判和危机管理。为了衡量通用安全与专业效用之间的差距，我们引入了Crisis-Bench，一个多智能体部分可观测马尔可夫决策过程（POMDP），评估LLMs在高风险企业危机中的表现。涵盖80个多样化的故事情节，跨越8个行业，Crisis-Bench让基于LLM的公共关系（PR）代理在动态7天企业危机模拟中导航，同时管理严格分离的私人和公共叙述状态以执行严格的信息不对称。与传统基准依赖静态真实值不同，我们引入了裁决者-市场循环：一种新的评估指标，其中公众情绪被裁决并转化为模拟股票价格，创建了现实的经济激励结构。我们的结果揭示了关键的二元对立：尽管某些模型屈从于道德关切，其他模型则展示了能够进行马基雅维利式的、合法的战略隐瞒能力，以稳定模拟股票价格。Crisis-Bench提供了首个定量框架来评估'声誉管理'能力，主张从僵化的道德绝对主义转向情境感知的专业对齐。
英文摘要：
Standard safety alignment optimizes Large Language Models (LLMs) for universal helpfulness and honesty, effectively instilling a rigid "Boy Scout" morality. While robust for general-purpose assistants, this one-size-fits-all ethical framework imposes a "transparency tax" on professional domains requiring strategic ambiguity and information withholding, such as public relations, negotiation, and crisis management. To measure this gap between general safety and professional utility, we introduce Crisis-Bench, a multi-agent Partially Observable Markov Decision Process (POMDP) that evaluates LLMs in high-stakes corporate crises. Spanning 80 diverse storylines across 8 industries, Crisis-Bench tasks an LLM-based Public Relations (PR) Agent with navigating a dynamic 7-day corporate crisis simulation while managing strictly separated Private and Public narrative states to enforce rigorous information asymmetry. Unlike traditional benchmarks that rely on static ground truths, we introduce the Adjudicator-Market Loop: a novel evaluation metric where public sentiment is adjudicated and translated into a simulated stock price, creating a realistic economic incentive structure. Our results expose a critical dichotomy: while some models capitulate to ethical concerns, others demonstrate the capacity for Machiavellian, legitimate strategic withholding in order to stabilize the simulated stock price. Crisis-Bench provides the first quantitative framework for assessing "Reputation Management" capabilities, arguing for a shift from rigid moral absolutism to context-aware professional alignment.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
