arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2411.07441cs.HCcs.AIcs.CY
收藏

自动检测在线欺骗模式

Automatically Detecting Online Deceptive Patterns

Asmit Nayak, Shirley Zhang, Yash Wani, Rishabh Khandelwal, Kassem Fawaz

AI总结:

AutoBot通过视觉模型和语言模型结合,自动检测网络中的欺骗模式,提供三个应用场景以帮助用户、开发者和研究人员应对在线欺骗问题。

摘要:

数字界面中的欺骗模式会操纵用户做出非意料的决策,利用认知偏见和心理脆弱性。这些模式已经普遍存在于各种数字平台上。尽管从法律和技术角度已经出现了努力减少欺骗模式的举措,但在创建实用且可扩展的解决方案方面仍存在显著空白。我们介绍了AutoBot框架来填补这一空白,并帮助网络相关方导航和减少在线欺骗模式。AutoBot能够从网站截图中准确识别和定位欺骗模式,而无需依赖底层HTML代码。AutoBot采用一个两阶段流程,利用专门的视觉模型来分析网站截图,识别交互元素并提取文本特征。接下来,利用大型语言模型,AutoBot理解这些元素周围的上下文以确定是否存在欺骗模式。我们还使用AutoBot来创建一个合成数据集,以从‘教师’LLM中提炼知识到较小的语言模型中。通过广泛的评估,我们证明了AutoBot在检测网络上的欺骗模式方面的有效性,当检测欺骗模式时,其F1分数达到0.93,凸显了其作为减少在线欺骗模式的重要工具的潜力。我们实现了AutoBot,用于三个下游应用,针对不同的网络相关方:(1)一个本地浏览器扩展,为用户提供实时反馈;(2)一个Lighthouse审计,通知开发人员其网站上潜在的欺骗模式;(3)作为研究人员和监管机构的测量工具。

英文摘要:

Deceptive patterns in digital interfaces manipulate users into making unintended decisions, exploiting cognitive biases and psychological vulnerabilities. These patterns have become ubiquitous on various digital platforms. While efforts to mitigate deceptive patterns have emerged from legal and technical perspectives, a significant gap remains in creating usable and scalable solutions. We introduce our AutoBot framework to address this gap and help web stakeholders navigate and mitigate online deceptive patterns. AutoBot accurately identifies and localizes deceptive patterns from a screenshot of a website without relying on the underlying HTML code. AutoBot employs a two-stage pipeline that leverages the capabilities of specialized vision models to analyze website screenshots, identify interactive elements, and extract textual features. Next, using a large language model, AutoBot understands the context surrounding these elements to determine the presence of deceptive patterns. We also use AutoBot, to create a synthetic dataset to distill knowledge from 'teacher' LLMs to smaller language models. Through extensive evaluation, we demonstrate AutoBot's effectiveness in detecting deceptive patterns on the web, achieving an F1-score of 0.93 when detecting deceptive patterns, underscoring its potential as an essential tool for mitigating online deceptive patterns. We implement AutoBot, across three downstream applications targeting different web stakeholders: (1) a local browser extension providing users with real-time feedback, (2) a Lighthouse audit to inform developers of potential deceptive patterns on their sites, and (3) as a measurement tool designed for researchers and regulators.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑