Differential privacy provides a formal approach to privacy of individuals. Applications of differential privacy in various scenarios, such as protecting users' original utterances, must satisfy certain mathematical properties. Our contribution is a formal analysis of ADePT, a differentially private auto-encoder for text rewriting (Krishna et al, 2021). ADePT achieves promising results on downstream tasks while providing tight privacy guarantees. Our proof reveals that ADePT is not differentially private, thus rendering the experimental results unsubstantiated. We also quantify the impact of the error in its private mechanism, showing that the true sensitivity is higher by at least factor 6 in an optimistic case of a very small encoder's dimension and that the amount of utterances that are not privatized could easily reach 100% of the entire dataset. Our intention is neither to criticize the authors, nor the peer-reviewing process, but rather point out that if differential privacy applications in NLP rely on formal guarantees, these should be outlined in full and put under detailed scrutiny.
School of Computer Science(计算机科学学院);Engineering, Central South University(工程学院,中南大学);Research Center for Social Computing(社会计算研究中心);Interactive Robotics, Harbin Institute of Technology(交互机器人研究,哈尔滨工业大学);Department of Computer Science, University of Hong Kong(计算机科学系,香港大学);Shenzhen International Graduate School, Tsinghua University(深圳国际研究生院,清华大学);Department of Computer Science, University of Illinons at Chicago(计算机科学系,伊利诺伊大学香槟分校)
When Low Resource NLP Meets Unsupervised Language Model: Meta-pretraining Then Meta-learning for Few-shot Text Classification
Zhejiang University(浙江大学);Alibaba-Zhejiang University Frontier Technology Research Center(阿里巴巴-浙江大学前沿技术研究中心);The First Affiliated Hospital of Zhejiang University(浙江大学医学院附属第一医院);Alibaba Group(阿里巴巴集团);Carnegie Mellon University(卡内基梅隆大学);Oxford University(牛津大学)
When Explainability Meets Privacy: An Investigation at the Intersection of Post-hoc Explainability and Differential Privacy in the Context of Natural Language Processing
When TableQA Meets Noise: A Dual Denoising Framework for Complex Questions and Large-scale Tables
University of Science and Technology of China(中国科学技术大学);The University of Melbourne(墨尔本大学);Institute of Artificial Intelligence, Hefei Comprehensive National Science Center(合肥综合性国家科学中心人工智能研究院)
When Large Language Models Meet Law: Dual-Lens Taxonomy, Technical Advances, and Ethical Governance
School of Law, China University of Political Science and Law(中国政法大学法学院);Zhejiang University of Finance and Economics Dongfang College(浙江财经大学东洋学院);School of Information Management for Law, China University of Political Science and Law(中国政法大学信息管理法学院);Department of Artificial Intelligence, Chung-Ang University(成均馆大学人工智能系);Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University(香港理工大学数据科学与人工智能系)