AI 中文总结
该研究开发了开源工具SILICA，测试12个大语言模型智能体群体与人类行为的契合度，发现多数模型仅起始行为与人类相近，最终行为、合作模式等均存在显著差距，仅推理训练模型表现接近人类，当前硅基智能体群体仅支持探索性研究。
AI 中文摘要
大语言模型智能体群体正日益被用作实验社会。每一项此类结果都存在三个疑问：智能体的行为是否与其所替代的人类相似；在规则未改变的情况下，研究结果是否能在装置变更后依然成立；表面上的社会动态是否属于真正的互动，而非模型所阅读实验的复制。本文介绍了SILICA，一款可同时测试这三个问题的开源工具。五个环境带有已发表的人类基准数据，每个环境均配有重新呈现相同规则的扰动项，以及收益指向与记忆结果相悖的变体。在单个消费级显卡上运行了12个开放权重模型。与人类数据的一致性仅局限于起始点：11个模型中有8个的第一轮公共物品贡献落在等效区间内，但没有模型能匹配最终状态贡献或人类的合作区间。仅交换两个行动的列出顺序就使一个模型的合作度损失了58个点。向回应者呈现固定的出价时间表显示，仅一个模型（唯一经过推理训练的模型）将其接受阈值置于激励要求的位置；两个模型的阈值移动了部分，两个移动方向错误，三个模型从未形成接受阈值。惯例是通过对名称的共同先验形成，而非通过协商，不过一旦该先验被打乱，协商就会重新出现。在此定义的认证阶梯上，当前的硅基智能体群体仅支持探索性主张，仅此而已。
英文摘要
Populations of large language model agents are increasingly used as experimental societies. Three doubts shadow every such result: whether the agents behave like the humans they stand in for, whether a finding survives changes to the apparatus that leave the rules untouched, and whether apparent social dynamics are interaction at all rather than the reproduction of experiments the models have read. This article introduces SILICA, an open instrument that tests all three. Five environments carry published human anchors, each paired with perturbations that re-render the same rules and with variants whose payoffs point away from the memorised result. Twelve open-weight models were run through it on a single consumer graphics card. Agreement with human data is confined to starting points: first-round public-goods contributions fall inside the equivalence margin for eight of eleven models, while no model matches end-state contributions or the human corridor of cooperation. Merely swapping the order in which two actions are listed costs one model 58 points of cooperation. Presenting responders with a fixed schedule of offers shows that only one model, the sole reasoning-trained one, places its acceptance threshold where the incentive requires; two move theirs part of the way, two move them the wrong way, and three never acquire one. Conventions form through a shared prior over the names rather than through negotiation, though negotiation reappears once that prior is disrupted. On the certification ladder defined here, current silicon societies support exploratory claims and no more.
