arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.04740cs.CLcs.AI
收藏

StealthGraph:通过知识图谱引导的有害提示生成暴露领域特定风险

StealthGraph: Exposing Domain-Specific Risks in LLMs through Knowledge-Graph-Guided Harmful Prompt Generation

School of Software Technology, Zhejiang University(浙江大学软件学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);State Key Lab of CAD&CG, Zhejiang University(浙江大学CAD&CG国家重点实验室)

Huawei Zheng, Xinqi Jiang, Sen Yang, Shouling Ji, Yingcai Wu, Dazhen Deng

AI总结:

本文提出StealthGraph框架,通过知识图谱生成领域相关的隐式有害提示,解决领域知识转化为约束和提升提示隐式的挑战,推动LLM安全研究。

摘要:

大型语言模型(LLMs)在金融和医疗等专业领域应用时引入了独特的安全风险。领域特定的有害提示数据集仍然稀缺,主要依赖人工构建;公开数据集主要关注显式有害提示,现代LLM防御可以轻易检测并拒绝。相比之下,隐式有害提示通过间接领域知识表达更难检测,更能反映现实威胁。本文识别了两个挑战:将领域知识转化为可操作的约束以及增加生成有害提示的隐式性。为此,我们提出一个端到端框架,首先通过知识图谱引导生成系统性的领域相关提示,然后应用双策略混淆重写将显式有害提示转换为隐式变体。该框架生成高质量数据集,结合强领域相关性和隐式性,使更真实的红队测试成为可能,推动LLM安全研究。我们已在GitHub上发布代码和数据集。

英文摘要:

Large language models (LLMs) are increasingly applied in specialized domains such as finance and healthcare, where they introduce unique safety risks. Domain-specific datasets of harmful prompts remain scarce and still largely rely on manual construction; public datasets mainly focus on explicit harmful prompts, which modern LLM defenses can often detect and refuse. In contrast, implicit harmful prompts-expressed through indirect domain knowledge-are harder to detect and better reflect real-world threats. We identify two challenges: transforming domain knowledge into actionable constraints and increasing the implicitness of generated harmful prompts. To address them, we propose an end-to-end framework that first performs knowledge-graph-guided harmful prompt generation to systematically produce domain-relevant prompts, and then applies two-strategy obfuscation rewriting to convert explicit harmful prompts into implicit variants via direct and context-enhanced rewriting. This framework yields high-quality datasets combining strong domain relevance with implicitness, enabling more realistic red-teaming and advancing LLM safety research. We release our code and datasets on GitHub.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑