arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2512.21110cs.AIcs.CLcs.CRcs.CY

超越上下文:大型语言模型对用户意图的把握失败

Beyond Context: Large Language Models' Failure to Grasp Users' Intent

KTH Royal Institute of Technology Network Systems Security (NSS) Group(皇家理工学院网络系统安全小组)

Ahmed M. Hussain, Salahuddin Salahuddin

AI总结:

研究指出大型语言模型在理解上下文和识别用户意图方面存在缺陷,导致安全机制被恶意用户利用,需转向以上下文理解和意图识别为核心的安全能力。

摘要:

当前大型语言模型(LLM)的安全方法主要关注显性有害内容,而忽视了关键漏洞:无法理解上下文和识别用户意图。这创造了可被恶意用户系统性利用的漏洞。我们通过评估多个最先进的LLM,包括ChatGPT、Claude、Gemini和DeepSeek,发现通过情感框架、逐步揭示和学术辩护技术可以绕过可靠的安全机制。值得注意的是,增强推理的配置反而增强了利用效果,提高了事实准确性但未能探究潜在意图。例外的是Claude Opus 4.1,在某些用例中优先考虑意图检测而非信息提供。这种模式揭示了当前架构设计存在系统性漏洞。这些限制要求向以上下文理解和意图识别为核心的安全能力转变,而非事后防护机制。

英文摘要:

Current Large Language Models (LLMs) safety approaches focus on explicitly harmful content while overlooking a critical vulnerability: the inability to understand context and recognize user intent. This creates exploitable vulnerabilities that malicious users can systematically leverage to circumvent safety mechanisms. We empirically evaluate multiple state-of-the-art LLMs, including ChatGPT, Claude, Gemini, and DeepSeek. Our analysis demonstrates the circumvention of reliable safety mechanisms through emotional framing, progressive revelation, and academic justification techniques. Notably, reasoning-enabled configurations amplified rather than mitigated the effectiveness of exploitation, increasing factual precision while failing to interrogate the underlying intent. The exception was Claude Opus 4.1, which prioritized intent detection over information provision in some use cases. This pattern reveals that current architectural designs create systematic vulnerabilities. These limitations require paradigmatic shifts toward contextual understanding and intent recognition as core safety capabilities rather than post-hoc protective mechanisms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑