AbuseGPT:滥用生成式 AI 聊天机器人创建短信钓鱼活动
AbuseGPT: Abuse of Generative AI ChatBots to Create Smishing Campaigns
AI总结:
本文提出AbuseGPT方法,揭示攻击者如何利用提示注入攻击绕过生成式AI聊天机器人的道德标准来创建短信钓鱼活动,为防范此类新兴网络安全威胁提供了实证依据与研究指南。
摘要:
短信钓鱼,也称为“smishing”,是一种日益增长的威胁,它通过欺诈性手机短信诱骗用户泄露私人信息或点击包含恶意内容的 URL。在最近的过去,我们也观察到对话式生成 AI 聊天机器人服务(例如 OpenAI 的 ChatGPT、Google 的 BARD)的快速发展,这些服务由预训练大型语言模型(LLMs)驱动。这些 AI 聊天机器人当然有很多用途,但尚未系统地了解它们如何在创建威胁和攻击中发挥作用。在本文中,我们提出了 AbuseGPT 方法,以展示攻击者如何在现实世界中利用现有的基于生成式 AI 的聊天机器人服务来创建短信钓鱼文本,并最终导致更狡猾的短信钓鱼活动。据我们所知,目前没有任何先前的工作明确展示这些基于生成文本的模型对创建短信钓鱼的影响。因此,我们相信这项研究是首个揭示这种新兴网络安全威胁的研究。我们发现了强有力的实证证据,表明攻击者可以通过精心制作提示注入攻击来利用现有基于生成式 AI 的聊天机器人服务中的道德标准,从而创建更新的短信钓鱼活动。我们还讨论了一些未来的研究方向和指南,以保护基于生成式 AI 的服务免受滥用,并保护用户免受短信钓鱼攻击。
英文摘要:
SMS phishing, also known as "smishing", is a growing threat that tricks users into disclosing private information or clicking into URLs with malicious content through fraudulent mobile text messages. In recent past, we have also observed a rapid advancement of conversational generative AI chatbot services (e.g., OpenAI's ChatGPT, Google's BARD), which are powered by pre-trained large language models (LLMs). These AI chatbots certainly have a lot of utilities but it is not systematically understood how they can play a role in creating threats and attacks. In this paper, we propose AbuseGPT method to show how the existing generative AI-based chatbot services can be exploited by attackers in real world to create smishing texts and eventually lead to craftier smishing campaigns. To the best of our knowledge, there is no pre-existing work that evidently shows the impacts of these generative text-based models on creating SMS phishing. Thus, we believe this study is the first of its kind to shed light on this emerging cybersecurity threat. We have found strong empirical evidences to show that attackers can exploit ethical standards in the existing generative AI-based chatbot services by crafting prompt injection attacks to create newer smishing campaigns. We also discuss some future research directions and guidelines to protect the abuse of generative AI-based services and safeguard users from smishing attacks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。