arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.05877cs.AIcs.HC
收藏

安全关键型LLM助手中的Agent2Agent威胁:以人为中心的分类

Agent2Agent Threats in Safety-Critical LLM Assistants: A Human-Centric Taxonomy

BMW Group Research(宝马集团研究);Technical University Munich(慕尼黑技术大学)

Lukas Stappen, Ahmet Erkan Turan, Johann Hagerer, Georg Groh

AI总结:

本文提出AgentHeLLM框架,通过分离资产识别与攻击路径分析,为安全关键型LLM助手提供以人为中心的威胁建模方法。

摘要:

将基于大型语言模型(LLM)的对话代理集成到车辆中,在代理AI、汽车安全和代理间通信的交汇处创造了新的安全挑战。随着这些智能助手通过如谷歌的Agent-to-Agent(A2A)等协议与外部服务协调,它们建立了攻击面,其中操纵可以通过自然语言负载传播,可能造成从司机分心到未经授权的车辆控制等严重后果。现有的AI安全框架虽然基础,但缺乏在安全关键系统工程中严格遵循

英文摘要:

The integration of Large Language Model (LLM)-based conversational agents into vehicles creates novel security challenges at the intersection of agentic AI, automotive safety, and inter-agent communication. As these intelligent assistants coordinate with external services via protocols such as Google's Agent-to-Agent (A2A), they establish attack surfaces where manipulations can propagate through natural language payloads, potentially causing severe consequences ranging from driver distraction to unauthorized vehicle control. Existing AI security frameworks, while foundational, lack the rigorous "separation of concerns" standard in safety-critical systems engineering by co-mingling the concepts of what is being protected (assets) with how it is attacked (attack paths). This paper addresses this methodological gap by proposing a threat modeling framework called AgentHeLLM (Agent Hazard Exploration for LLM Assistants) that formally separates asset identification from attack path analysis. We introduce a human-centric asset taxonomy derived from harm-oriented "victim modeling" and inspired by the Universal Declaration of Human Rights, and a formal graph-based model that distinguishes poison paths (malicious data propagation) from trigger paths (activation actions). We demonstrate the framework's practical applicability through an open-source attack path suggestion tool AgentHeLLM Attack Path Generator that automates multi-stage threat discovery using a bi-level search strategy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑