合成信任攻击：生成式AI如何操纵人类在社会工程欺诈中的决策
Synthetic Trust Attacks: Modeling How Generative AI Manipulates Human Decisions in Social Engineering Fraud
AI总结：
本文提出合成信任攻击（STA）作为正式威胁类别，引入STAM模型，涵盖从敌手侦察到事后利用的完整攻击链，探讨人类决策层的防御策略。
摘要：
想象你接到 CFO 的视频通话，周围是同事，要求紧急批准机密转账。你遵从了，但所有参与者都是假的，你刚刚损失了 2500 万美元。这不是假设，2024 年 1 月在香港发生了，成为新一代欺诈的模板。AI 并未发明新罪，而是工业化了古老罪行：信任制造。本文提出合成信任攻击（STAs）作为正式威胁类别，并引入 STAM，即合成信任攻击模型，一个八阶段的操作框架，涵盖从敌手侦察到事后利用的完整攻击链。核心论点是：现有防御针对合成媒体检测，但真正的攻击面是受害者的决策。当人类深度伪造检测准确率约为 55.5%， barely 超过偶然，而 LLM 欺骗代理达到 46% 的合规率，而人类操作员仅为 18%，同时完全规避安全过滤器，感知层已失败。防御必须转向决策层。本文还提出一个五类信任提示分类，一个可重复的 17 个字段事件编码方案，以及四个可验证的假设，将攻击结构与合规结果联系起来。本文进一步将作者开发的 Calm, Check, Confirm 协议作为研究级决策层防御。合成可信度，而非合成媒体，是 AI 欺诈时代的真正攻击面。
英文摘要：
Imagine receiving a video call from your CFO, surrounded by colleagues, asking you to urgently authorise a confidential transfer. You comply. Every person on that call was fake, and you just lost $25 million. This is not a hypothetical. It happened in Hong Kong in January 2024, and it is becoming the template for a new generation of fraud. AI has not invented a new crime. It has industrialised an ancient one: the manufacture of trust. This paper proposes Synthetic Trust Attacks (STAs) as a formal threat category and introduces STAM, the Synthetic Trust Attack Model, an eight-stage operational framework covering the full attack chain from adversary reconnaissance through post-compliance leverage. The core argument is this: existing defenses target synthetic media detection, but the real attack surface is the victim's decision. When human deepfake detection accuracy sits at approximately 55.5%, barely above chance, and LLM scam agents achieve 46% compliance versus 18% for human operators while evading safety filters entirely, the perception layer has already failed. Defense must move to the decision layer. We present a five-category Trust-Cue Taxonomy, a reproducible 17-field Incident Coding Schema with a pilot-coded example, and four falsifiable hypotheses linking attack structure to compliance outcomes. The paper further operationalizes the author's practitioner-developed Calm, Check, Confirm protocol as a research-grade decision-layer defense. Synthetic credibility, not synthetic media, is the true attack surface of the AI fraud era.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
