Robustness evaluation against adversarial examples has become increasingly important to unveil the trustworthiness of the prevailing deep models in natural language processing (NLP). However, in contrast to the computer vision domain where the first-order projected gradient descent (PGD) is used as the benchmark approach to generate adversarial examples for robustness evaluation, there lacks a principled first-order gradient-based robustness evaluation framework in NLP. The emerging optimization challenges lie in 1) the discrete nature of textual inputs together with the strong coupling between the perturbation location and the actual content, and 2) the additional constraint that the perturbed text should be fluent and achieve a low perplexity under a language model. These challenges make the development of PGD-like NLP attacks difficult. To bridge the gap, we propose TextGrad, a new attack generator using gradient-driven optimization, supporting high-accuracy and high-quality assessment of adversarial robustness in NLP. Specifically, we address the aforementioned challenges in a unified optimization framework. And we develop an effective convex relaxation method to co-optimize the continuously-relaxed site selection and perturbation variables and leverage an effective sampling method to establish an accurate mapping from the continuous optimization variables to the discrete textual perturbations. Moreover, as a first-order attack generation method, TextGrad can be baked into adversarial training to further improve the robustness of NLP models. Extensive experiments are provided to demonstrate the effectiveness of TextGrad not only in attack generation for robustness evaluation but also in adversarial defense.
HatePRISM: Policies, Platforms, and Research Integration. Advancing NLP for Hate Speech Proactive Mitigation
IIT Kharagpur(印度理工学院Kharagpur分校);University of Hamburg(汉堡大学);Technical University of Munich(慕尼黑技术大学);Bucerius Law School(布勒斯海姆法学院);Skolkovo Institute of Science and Technology(斯克尔科维科学与技术研究所);Artificial Intelligence Research Institute(人工智能研究 institute)
The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African NLP
University of California, Los Angeles(加州大学洛杉矶分校);Georgia Institute of Technology(佐治亚理工学院);University of Wisconsin - Madison(威斯康星大学麦迪逊分校);University of Cape Coast(科克伍德大学);Carleton University(卡尔顿大学);Stetson University(史蒂文森大学);Northwestern University in Qatar(卡塔尔西北大学);Cornell University(康奈尔大学);Soka University of America(美国立命大学);Columbia University(哥伦比亚大学)
Natural Language Processing with Commonsense Knowledge: A Survey
College of Information Engineering Shanghai Maritime University;Independent Researcher;School of AI;Advanced Computing Xi'an Jiaotong-Liverpool University;Alibaba Business School Hangzhou Normal University;School of Computer
Systematic Exploration of Dialogue Summarization Approaches for Reproducibility, Comparative Assessment, and Methodological Innovations for Advancing Natural Language Processing in Abstractive Summarization
SRM Institute of Science and Technology(SRM科学技术学院);SRM University, AP(SRM大学(安得拉邦))
Enhancing NLP Robustness and Generalization through LLM-Generated Contrast Sets: A Scalable Framework for Systematic Evaluation and Adversarial Training
College of Natural Sciences, The University of Texas at Austin(德克萨斯大学奥斯汀分校自然科学学院)
SportQA: A Benchmark for Sports Understanding in Large Language Models
University of California, Irvine(加州大学欧文分校);Stanford University(斯坦福大学);University of California, Santa Barbara(加州大学圣巴巴拉分校);Meta Platforms, Inc.(元平台公司);Beijing Normal University(北京师范大学)
Advancing the Robustness of Large Language Models through Self-Denoised Smoothing
UC Santa Barbara(加州大学圣巴巴拉分校);Max Planck Institute for Intelligent Systems, Tübingen(马克斯·普朗克智能系统研究所(蒂宾根));The Hong Kong Polytechnic University(香港理工大学);MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);Cisco Research(思科研究院);Michigan State University(密歇根州立大学)