Deceptive patterns in digital interfaces manipulate users into making unintended decisions, exploiting cognitive biases and psychological vulnerabilities. These patterns have become ubiquitous on various digital platforms. While efforts to mitigate deceptive patterns have emerged from legal and technical perspectives, a significant gap remains in creating usable and scalable solutions. We introduce our AutoBot framework to address this gap and help web stakeholders navigate and mitigate online deceptive patterns. AutoBot accurately identifies and localizes deceptive patterns from a screenshot of a website without relying on the underlying HTML code. AutoBot employs a two-stage pipeline that leverages the capabilities of specialized vision models to analyze website screenshots, identify interactive elements, and extract textual features. Next, using a large language model, AutoBot understands the context surrounding these elements to determine the presence of deceptive patterns. We also use AutoBot, to create a synthetic dataset to distill knowledge from 'teacher' LLMs to smaller language models. Through extensive evaluation, we demonstrate AutoBot's effectiveness in detecting deceptive patterns on the web, achieving an F1-score of 0.93 when detecting deceptive patterns, underscoring its potential as an essential tool for mitigating online deceptive patterns. We implement AutoBot, across three downstream applications targeting different web stakeholders: (1) a local browser extension providing users with real-time feedback, (2) a Lighthouse audit to inform developers of potential deceptive patterns on their sites, and (3) as a measurement tool designed for researchers and regulators.
Caught in the Act: a mechanistic approach to detecting deception
Barcelona Institute of Science and Technology(巴塞罗那科学与技术研究所);NorthWest Arkansas Community College(西北阿肯色社区学院);Carnegie Mellon University(卡内基梅隆大学);Harvard University(哈佛大学)
DarkPatterns-LLM: A Multi-Layer Benchmark for Detecting Manipulative and Harmful AI Behavior
Rensselaer Polytechnic Institute(拉特格斯理工学院);National University of Sciences and Technology(国立科学与技术大学);School of Electrical Engineering & Computer Science(电子与计算机科学学院)
Detecting Dark Patterns in User Interfaces Using Logistic Regression and Bag-of-Words Representation
University of Portsmouth(朴茨茅斯大学);Jigawa State Polytechnic for ICT(吉加瓦州信息与通信技术理工学院);Beihang University(北京航空航天大学);Shehu Shagari College of Education Sokoto(索科托谢胡·沙加里教育学院)