Active learning enables the efficient construction of a labeled dataset by labeling informative samples from an unlabeled dataset. In a real-world active learning scenario, considering the diversity of the selected samples is crucial because many redundant or highly similar samples exist. Core-set approach is the promising diversity-based method selecting diverse samples based on the distance between samples. However, the approach poorly performs compared to the uncertainty-based approaches that select the most difficult samples where neural models reveal low confidence. In this work, we analyze the feature space through the lens of the density and, interestingly, observe that locally sparse regions tend to have more informative samples than dense regions. Motivated by our analysis, we empower the core-set approach with the density-awareness and propose a density-aware core-set (DACS). The strategy is to estimate the density of the unlabeled samples and select diverse samples mainly from sparse regions. To reduce the computational bottlenecks in estimating the density, we also introduce a new density approximation based on locality-sensitive hashing. Experimental results clearly demonstrate the efficacy of DACS in both classification and regression tasks and specifically show that DACS can produce state-of-the-art performance in a practical scenario. Since DACS is weakly dependent on neural architectures, we present a simple yet effective combination method to show that the existing methods can be beneficially combined with DACS.
Repurposing Adversarial Perturbations for Continual Learning: From Defense to Active Alignment
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络安全学院);Deakin University(德肯大学);Harbin Engineering University(哈尔滨工程大学)
RAP: Robustness-Aware Perturbations for Defending against Backdoor Attacks on NLP Models
Center for Data Science, Peking University(北京大学数据科学中心);Pattern Recognition Center, WeChat AI, Tencent Inc.(腾讯公司微信AI模式识别中心);MOE Key Laboratory of Computational Linguistics, School of EECS, Peking University(北京大学信息工程学院教育部计算语言学重点实验室)
Mitigating Malicious Attacks in Federated Learning via Confidence-aware Defense
Queen Mary University of London(伦敦玛丽女王大学);University of Oxford(牛津大学);Huazhong University of Science and Technology(华中科技大学);Shandong University of Technology(山东理工大学)
Noise-Aware and Dynamically Adaptive Federated Defense Framework for SAR Image Target Recognition
Shanxi Key Laboratory of Cryptography and Data Security, School of Computer Science and Artificial Intelligence, Shanxi Normal University(山西密码与数据安全重点实验室,计算机科学与人工智能学院,山西师范大学);School of Computer Science and Technology, Guizhou University(贵州大学计算机科学与技术学院);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);School of Electrical Engineering, Guangxi University(广西大学电气工程学院);School of Computing, Engineering and Mathematical Science, La Trobe University(拉筹伯大学计算、工程与数学科学学院);College of Cyber Security, Jinan University(济南大学网络安全学院)
CITED: A Decision Boundary-Aware Signature for GNNs Towards Model Extraction Defense
Department of Computer Science, Florida State University, Tallahassee, Florida, United States(佛罗里达州立大学计算机科学系);Department of Mathematics, University of Wisconsin, Madison, Wisconsin, United States(威斯康星大学麦迪逊分校数学系)