事前评估人工智能引发的创意多样性崩溃
Ex Ante Evaluation of AI-Induced Idea Diversity Collapse
AI总结:
本文提出一种人类相对框架,用于基准测试AI导致的人类多样性崩溃,通过模型生成内容和未辅助人类基线的比较,评估创意多样性崩溃风险,展示多样性崩溃的可识别性及减少方法。
摘要:
创意AI系统通常在个体效用层面进行评估,但创意输出在群体中被消费:当许多人产生相似想法时,一个想法的价值会降低。这导致了评估盲区,因为AI可以提高个体输出的同时增加群体层面的拥挤。我们引入了一种人类相对的基准框架,无需人类-AI交互数据,提供一种事前协议来估计从模型生成内容和匹配的未辅助人类基线中拥挤风险。通过将想法视为拥堵资源,我们证明了从分布内比较中可以识别源级拥挤,得到超额拥挤系数Δ和人类相对多样性比率ρ。我们展示ρ≥1是无超额拥挤的平衡条件,并将Δ与具有暴露依赖性冗余成本的采用游戏联系起来。在短篇故事、营销标语和替代用途任务中,三个前沿LLM在拥挤核上均低于平衡点。估计在可行的模型生成样本量下稳定。重要的是,生成协议变体表明,通过有针对性的设计可以减少拥挤,使多样性崩溃成为一种可操作的、开发时的评估目标,用于群体意识的创意AI。
英文摘要:
Creative AI systems are typically evaluated at the level of individual utility, yet creative outputs are consumed in populations: an idea loses value when many others produce similar ones. This creates an evaluation blind spot, as AI can improve individual outputs while increasing population-level crowding. We introduce a human-relative framework for benchmarking AI-induced human diversity collapse without requiring human-AI interaction data, providing an ex ante protocol to estimate crowding risk from model-only generations and matched unaided human baselines. By modeling ideas as congestible resources, we show that source-level crowding is identifiable from within-distribution comparisons, yielding an excess-crowding coefficient $Δ$ and a human-relative diversity ratio $ρ$. We show that $ρ\ge1$ is the no-excess-crowding parity condition and connect $Δ$ to an adoption game with exposure-dependent redundancy costs. Across short stories, marketing slogans, and alternative-uses tasks, three frontier LLMs fall below parity across crowding kernels. Estimates stabilize with feasible model-only sample sizes. Importantly, generation-protocol variants show that crowding can be reduced through targeted design, making diversity collapse an actionable, development-time evaluation target for population-aware creative AI.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。