评估AI生成与人类撰写的鱼叉式网络钓鱼短信攻击:一项实证研究
Assessing AI-Generated vs. Human-Authored Spear Phishing SMS Attacks: An Empirical Study
AI总结:
本研究对比GPT-4与新手学生撰写的个性化钓鱼短信,发现AI生成消息引发点击意图比例略高,工作相关消息更易诱导点击,参与者无法准确判断消息来源,还验证了TRAPD的价值与局限。
摘要:
个性化钓鱼攻击难以防御,因为消息可针对目标的工作、兴趣和社交背景量身定制。大语言模型可能让这种定制过程更快、更简便,但目前仍不清楚通过简单提示生成的消息是否比人类撰写的更具说服力。这项针对25个目标的试点研究,将GPT-4生成的个性化钓鱼短信与受时间限制的新手学生撰写的消息进行了对比。研究采用了提出的个性化欺骗阈值排序方法(TRAPD),参与者对为他们撰写的12条消息进行排序,表明他们打算点击的节点,解释推理过程,并判断每条消息是由GPT-4还是人类撰写的。GPT-4生成的消息引发点击意图的比例高于学生撰写的消息(28%对21%),尽管该差异存在不确定性。更广泛而言,本研究结果表明,在这项试点研究的不确定性范围内,简单提示可生成参与者认为具有相当说服力的个性化消息。与爱好或社交媒体相关的消息相比,与工作相关的消息引发点击意图的可能性显著更高。当被要求判断消息来源是人类还是AI时,参与者的判断准确度不高于随机水平,尽管两组特定研究的消息集基于文本仍可在计算上区分。总体而言,这些发现表明,可访问的AI辅助个性化可能会扩大社会工程威胁的实际规模,同时也证明了TRAPD在可控且合乎伦理的对比中的价值与当前局限性。
英文摘要:
Personalized phishing is difficult to defend against because messages can be tailored to a target's work, interests, and social context. Large language models may make such tailoring faster and easier, but it remains unclear whether messages produced from simple prompts are more convincing than those written by people. This 25-target pilot study compared personalized smishing messages generated by GPT-4 with messages written by novice student authors working under time constraints. Using the proposed Threshold Ranking Approach for Personalized Deception (TRAPD), participants ranked 12 messages written for them, indicated the point at which they would intend to click, explained their reasoning, and judged whether each message was authored by GPT-4 or a human. GPT-4-generated messages elicited an intention to click more often than student-authored messages (28% versus 21%), although the difference was uncertain. More broadly, our findings suggest that a simple prompt can produce personalized messages that participants found comparably convincing within the uncertainty of this pilot study. Job-related messages were significantly more likely to elicit an intention to click than hobby- or social-media-related messages. When asked whether a message was written by a human or generated by AI, participants identified the source no more accurately than chance, although the two study-specific message sets remained computationally distinguishable based on their text. Together, these findings suggest that accessible AI-assisted personalization may increase the practical scale of social-engineering threats, while also demonstrating both the value and current limitations of TRAPD for controlled and ethical comparison.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。