Personal photos of individuals when shared online, apart from exhibiting a myriad of memorable details, also reveals a wide range of private information and potentially entails privacy risks (e.g., online harassment, tracking). To mitigate such risks, it is crucial to study techniques that allow individuals to limit the private information leaked in visual data. We tackle this problem in a novel image obfuscation framework: to maximize entropy on inferences over targeted privacy attributes, while retaining image fidelity. We approach the problem based on an encoder-decoder style architecture, with two key novelties: (a) introducing a discriminator to perform bi-directional translation simultaneously from multiple unpaired domains; (b) predicting an image interpolation which maximizes uncertainty over a target set of attributes. We find our approach generates obfuscated images faithful to the original input images, and additionally increase uncertainty by 6.2$\times$ (or up to 0.85 bits) over the non-obfuscated counterparts.
Massachusetts Institute of Technology（麻省理工学院）；Indian Institute of Information Technology, Bangalore（班加罗尔印度信息技术学院）
In this paper we investigate the usage of adversarial perturbations for the purpose of privacy from human perception and model (machine) based detection. We employ adversarial perturbations for obfuscating certain variables in raw data while preserving the rest. Current adversarial perturbation methods are used for data poisoning with minimal perturbations of the raw data such that the machine learning model's performance is adversely impacted while the human vision cannot perceive the difference in the poisoned dataset due to minimal nature of perturbations. We instead apply relatively maxima…
Carnegie Mellon University（卡内基梅隆大学）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Massachusetts Institute of Technology（麻省理工学院）
While the advent of Graph Neural Networks (GNNs) has greatly improved node and graph representation learning in many applications, the neighborhood aggregation scheme exposes additional vulnerabilities to adversaries seeking to extract node-level information about sensitive attributes. In this paper, we study the problem of protecting sensitive attributes by information obfuscation when learning with graph structured data. We propose a framework to locally filter out pre-determined sensitive attributes via adversarial training with the total variation and the Wasserstein distance. Our method c…
Face obfuscation (blurring, mosaicing, etc.) has been shown to be effective for privacy protection; nevertheless, object recognition research typically assumes access to complete, unobfuscated images. In this paper, we explore the effects of face obfuscation on the popular ImageNet challenge visual recognition benchmark. Most categories in the ImageNet challenge are not people categories; however, many incidental people appear in the images, and their privacy is a concern. We first annotate faces in the dataset. Then we demonstrate that face obfuscation has minimal impact on the accuracy of re…
Massachusetts Institute of Technology（麻省理工学院）；Harvard Medical School（哈佛医学院）
Recent deep learning models have shown remarkable performance in image classification. While these deep learning systems are getting closer to practical deployment, the common assumption made about data is that it does not carry any sensitive information. This assumption may not hold for many practical cases, especially in the domain where an individual's personal information is involved, like healthcare and facial recognition systems. We posit that selectively removing features in this latent space can protect the sensitive information and provide a better privacy-utility trade-off. Consequen…
FoolSDEdit: Deceptively Steering Your Edits Towards Targeted Attribute-aware Distribution
Zhejiang University（浙江大学）；Nanyang Technological University（南洋理工大学）；Institute of High Performance Computing (IHPC)（高性能计算研究所）；Centre for Frontier AI Research (CFAR)（前沿人工智能研究中心）
Queen Mary University of London（伦敦玛丽女王大学）；University of Trento（特伦托大学）
This work addresses the problem of anonymizing the identity of faces in a dataset of images, such that the privacy of those depicted is not violated, while at the same time the dataset is useful for downstream task such as for training machine learning models. To the best of our knowledge, we are the first to explicitly address this issue and deal with two major drawbacks of the existing state-of-the-art approaches, namely that they (i) require the costly training of additional, purpose-trained neural networks, and/or (ii) fail to retain the facial attributes of the original images in the anon…
Attributes Shape the Embedding Space of Face Recognition Models
Department of Mathematical Sciences, Politecnico di Torino, Turin, Italy（波兰理工学院数学科学系）；Department of Computer Science, University of Pisa, Pisa, Italy（比萨大学计算机科学系）；CENTAI Institute, Turin, Italy（CENTAI研究院）
Purdue University（普渡大学）；University of Rochester（罗切斯特大学）
With billions of personal images being generated from social media and cameras of all sorts on a daily basis, security and privacy are unprecedentedly challenged. Although extensive attempts have been made, existing face image de-identification techniques are either insufficient in photo-reality or incapable of balancing privacy and usability qualitatively and quantitatively, i.e., they fail to answer counterfactual questions such as "is it private now?", "how private is it?", and "can it be more private?" In this paper, we propose a novel framework called AnonymousNet, with an effort to addre…
TAGE: Trustworthy Attribute Group Editing for Stable Few-shot Image Generation
Guangdong University of Technology（广东工业大学）；Macao Polytechnic University（澳门理工大学）；Huizhou University（惠州学院）；Guangdong University of Foreign Studies（广东外语外贸大学）
University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
Controllable semantic image editing enables a user to change entire image attributes with a few clicks, e.g., gradually making a summer scene look like it was taken in winter. Classic approaches for this task use a Generative Adversarial Net (GAN) to learn a latent space and suitable latent-space transformations. However, current approaches often suffer from attribute edits that are entangled, global image identity changes, and diminished photo-realism. To address these concerns, we learn multiple attribute transformations simultaneously, integrate attribute regression into the training of tra…
Shanghai Jiao Tong University（上海交通大学）；Southern University of Science and Technology（南方科技大学）；Huawei International（华为国际）
In order to prevent leaking input information from intermediate-layer features, this paper proposes a method to revise the traditional neural network into the rotation-equivariant neural network (RENN). Compared to the traditional neural network, the RENN uses d-ary vectors/tensors as features, in which each element is a d-ary number. These d-ary features can be rotated (analogous to the rotation of a d-dimensional vector) with a random angle as the encryption process. Input information is hidden in this target phase of d-ary features for attribute obfuscation. Even if attackers have obtained …
SemanticAdv: Generating Adversarial Examples via Attribute-conditional Image Editing
The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；University of Michigan, Ann Arbor（密歇根大学安娜堡分校）；The Chinese University of Hong Kong（香港中文大学）；Uber ATG（优步先进技术集团）；University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）
Unsupervised Region-Based Image Editing of Denoising Diffusion Models
Institute of Information Science, Beijing Jiaotong University（北京交通大学信息科学研究所）；Pengcheng Laboratory（鹏城实验室）；University of Trento（特伦托大学）；Lanzhou Jiaotong University（兰州交通大学）
Face editing represents a popular research topic within the computer vision and image processing communities. While significant progress has been made recently in this area, existing solutions: (i) are still largely focused on low-resolution images, (ii) often generate editing results with visual artefacts, or (iii) lack fine-grained control and alter multiple (entangled) attributes at once, when trying to generate the desired facial semantics. In this paper, we aim to address these issues though a novel attribute editing approach called MaskFaceGAN that focuses on local attribute editing. The…
Overcoming False Illusions in Real-World Face Restoration with Multi-Modal Guided Diffusion Model
Xidian University（西安电子科技大学）；The University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）；State Key Laboratory of Integrated Services Networks（集成服务网络国家重点实验室）
