arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2502.05461cs.CR
收藏

IllusionCAPTCHA:一种基于视错觉的验证码

IllusionCAPTCHA: A CAPTCHA based on Visual Illusion

Ziqi Ding, Gelei Deng, Yi Liu, Junchen Ding, Jieshan Chen, Yulei Sui, Yuekang Li

AI总结:

针对大语言模型削弱现有验证码有效性的问题,本研究提出基于视错觉的IllusionCAPTCHA,通过结构化误导选项实现100%欺骗大语言模型,同时86.95%的人类用户可首次尝试通过。

摘要:

长期以来,CAPTCHA(验证码)一直是保护应用免受自动化机器人攻击的核心工具。它最初被设计为用于区分人类与机器人的简单问题,但随着恶意攻击者使用的验证码破解技术不断泛滥,验证码的复杂度也日益提升。然而,随着先进大语言模型(LLM)的出现,现有验证码的有效性正遭到削弱。\n 为解决这一问题,我们开展了一项实证研究,评估多模态大语言模型在破解验证码方面的性能,同时统计人类用户通过验证码通常需要的尝试次数。研究结果显示,尽管大语言模型能破解大多数验证码,但它们在应对需要复杂推理的验证码时存在困难,而这类验证码对人类用户来说也极具挑战性。有趣的是,我们的用户研究表明,大多数人类参与者需要尝试两次才能通过这类推理型验证码,这一发现在此前的研究中尚未被报道。\n 基于实证研究结果,我们提出了IllusionCAPTCHA——一种采用“人类易解、AI难解”范式的新型安全机制。这款新型验证码利用视错觉设计任务,这类任务对人类来说直观易懂,但对AI模型而言却极具迷惑性。此外,我们开发了一套结构化的分步方法来生成误导性选项,这些选项会专门引导大语言模型做出错误选择,降低其成功破解验证码的概率。我们的评估显示,IllusionCAPTCHA能100%有效欺骗大语言模型。不仅如此,我们的结构化设计大幅提升了AI尝试破解这类挑战时的出错概率。用户研究结果表明,86.95%的参与者首次尝试就成功通过了该验证码,表现优于其他验证码系统。

英文摘要:

CAPTCHAs have long been essential tools for protecting applications from automated bots. Initially designed as simple questions to distinguish humans from bots, they have become increasingly complex to keep pace with the proliferation of CAPTCHA-cracking techniques employed by malicious actors. However, with the advent of advanced large language models (LLMs), the effectiveness of existing CAPTCHAs is now being undermined. To address this issue, we have conducted an empirical study to evaluate the performance of multimodal LLMs in solving CAPTCHAs and to assess how many attempts human users typically need to pass them. Our findings reveal that while LLMs can solve most CAPTCHAs, they struggle with those requiring complex reasoning type of CAPTCHA that also presents significant challenges for human users. Interestingly, our user study shows that the majority of human participants require a second attempt to pass these reasoning CAPTCHAs, a finding not reported in previous research. Based on empirical findings, we present IllusionCAPTCHA, a novel security mechanism employing the "Human-Easy but AI-Hard" paradigm. This new CAPTCHA employs visual illusions to create tasks that are intuitive for humans but highly confusing for AI models. Furthermore, we developed a structured, step-by-step method that generates misleading options, which particularly guide LLMs towards making incorrect choices and reduce their chances of successfully solving CAPTCHAs. Our evaluation shows that IllusionCAPTCHA can effectively deceive LLMs 100% of the time. Moreover, our structured design significantly increases the likelihood of AI errors when attempting to solve these challenges. Results from our user study indicate that 86.95% of participants successfully passed the CAPTCHA on their first attempt, outperforming other CAPTCHA systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑