IO Factory：大规模模拟AI驱动的影响力行动

中文摘要 AI 辅助

我们推出IO Factory，这是一个AI驱动的框架，用于将信息与影响力行动模拟为完全集成、可追踪的过程。如今，数字操纵的威胁已从单个语言模型生成的说服性文本扩展到AI集群，即持续的协调智能体群体，它们会适应平台反馈并将有组织的行动伪装成普通社交互动。由于仅从孤立的消息中无法识别此类行动，必须在规划、平台行动、曝光、解读、测量和适应的连续范围内对其进行分析。IO Factory在受控的模拟平台内呈现这一过程，将行动者角色、平台行动、曝光记录、结构化的基于模型的评估以及模拟群体的配置变化关联起来。我们实现了该架构，并在多达100,000个智能体的配置中对其进行评估。结果表明，IO Factory可大规模执行行动时间线，并生成可检查的曝光证据及配置的信念变量的可测量变化。通过记录每次运行中使用的行动者、目标、行动约束、曝光路径和测量规则，IO Factory支持可重复的研究以及对协调影响力的红队分析。

英文摘要

We introduce IO Factory, an AI-driven framework for simulating information and influence campaigns as fully integrated, traceable processes. The threat of digital manipulation now extends beyond persuasive text from individual language models to AI swarms, i.e., persistent groups of coordinated agents that adapt to platform feedback and disguise organized campaigns as ordinary social interaction. Because such campaigns cannot be identified from isolated messages alone, they must be analyzed across a continuous spectrum of planning, platform action, exposure, interpretation, measurement, and adaptation. IO Factory represents this process inside a controlled simulated platform, linking actor roles, platform actions, exposure records, structured model-based evaluations, and configured changes in the simulated population. We implement the architecture and evaluate it across configurations of up to 100,000 agents. The results show that IO Factory executes campaign timelines at scale and produces inspectable evidence of exposure and measured movement in configured belief variables. By recording the actors, objectives, action constraints, exposure paths, and measurement rules used in each run, IO Factory supports reproducible research and red-team analysis of coordinated influence.

发表机构

• King’s College London（伦敦国王学院）
• Max Planck Institute for Security and Privacy（马克斯·普朗克安全与隐私研究所）
• BI Norwegian Business School（挪威商学院）
• University of Oslo（奥斯陆大学）
• SINTEF Digital（SINTEF数字研究所）
• Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）

机构由 AI 辅助整理，请以论文原文为准。