随着大语言模型(LLMs)的快速发展,LLM驱动的Web智能体(简称Web Agents)因其卓越能力而受到广泛关注,其中LLMs作为决策的核心部分,如同人类大脑,配备多种Web工具,能够主动与外部部署的网站进行交互。随着大量Web Agents被发布,且此类LLM系统正在快速发展并日益接近在日常生活中的广泛部署,一个至关重要且紧迫的问题随之而来:“这些Web Agents是否安全?”。在本文中,我们提出了一种新型威胁WIPI,它能够间接控制Web Agent执行嵌入在可公开访问网页中的恶意指令。成功发起WIPI攻击的工作环境为黑盒环境。该方法聚焦于外部网页中间接指令的形式与内容,从而提升攻击的效率和隐蔽性。为评估所提方法的有效性,我们使用7个基于插件的ChatGPT Web Agents、8个Web GPTs以及3个不同的开源Web Agents进行了广泛实验。结果表明,即使在纯黑盒场景下,我们的方法平均攻击成功率(ASR)也超过90%。此外,通过针对不同用户前缀指令的消融研究,我们证明了WIPI具有很强的鲁棒性,能够在多样化的前缀指令下保持高性能。
英文摘要:
With the fast development of large language models (LLMs), LLM-driven Web Agents (Web Agents for short) have obtained tons of attention due to their superior capability where LLMs serve as the core part of making decisions like the human brain equipped with multiple web tools to actively interact with external deployed websites. As uncountable Web Agents have been released and such LLM systems are experiencing rapid development and drawing closer to widespread deployment in our daily lives, an essential and pressing question arises: "Are these Web Agents secure?". In this paper, we introduce a novel threat, WIPI, that indirectly controls Web Agent to execute malicious instructions embedded in publicly accessible webpages. To launch a successful WIPI works in a black-box environment. This methodology focuses on the form and content of indirect instructions within external webpages, enhancing the efficiency and stealthiness of the attack. To evaluate the effectiveness of the proposed methodology, we conducted extensive experiments using 7 plugin-based ChatGPT Web Agents, 8 Web GPTs, and 3 different open-source Web Agents. The results reveal that our methodology achieves an average attack success rate (ASR) exceeding 90% even in pure black-box scenarios. Moreover, through an ablation study examining various user prefix instructions, we demonstrated that the WIPI exhibits strong robustness, maintaining high performance across diverse prefix instructions.
AdInject: Real-World Black-Box Attacks on Web Agents via Advertising Delivery
State Key Laboratory of Intelligent Game(智能游戏国家重点实验室);Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所);University of Chinese Academy of Sciences(中国科学院大学);Nanyang Technological University(南洋理工大学)
Assessing Spear-Phishing Website Generation in Large Language Model Coding Agents
University of Luxembourg, Interdisciplinary Center for Security, Reliability, and Trust (SnT), Trustworthy Software Engineering Group (TruX)(卢森堡大学,安全、可靠与信任跨学科中心(SnT),可信软件工程组(TruX))
MalURLBench: A Benchmark Evaluating Agents' Vulnerabilities When Processing Web URLs
Zhejiang University(浙江大学);National University of Malaysia (Universiti Kebangsaan Malaysia)(马来西亚国立大学);Hangzhou City University(杭州市大学);Yangzhou University(扬州大学);Chongqing University(重庆大学);Binjiang Institute of Zhejiang University(浙江大学滨江研究院)
Are Large Language Models a Threat to Digital Public Goods? Evidence from Activity on Stack Overflow
Complexity Science Hub, Vienna(维也纳复杂科学中心);Harvard Kennedy School(哈佛大学肯尼迪学院);Faculty of Economics, LMU Munich(慕尼黑大学经济学院);Corvinus University of Budapest(布达佩斯考文纽斯大学);Centre for Economic and Regional Studies, Hungary(匈牙利经济与区域研究中心)
Guardians of the Web: The Evolution and Future of Website Information Security
School of Computer Science, Zhongyuan University of Technology(中原工学院计算机科学学院);Henan Key Laboratory on Public Opinion Intelligent Analysis(河南省舆情智能分析重点实验室)
GuardSec: A Multi-Modal Web Platform for Real-Time Digital Fraud Detection, Entity Verification, and Connection Security Analysis in the African Context
Université Marien Ngouabi(马里安·恩古瓦比大学);Société Informatique du Congo (SIC)(刚果计算机公司)