PALI-NLP任务4:区分性微调Transformers以检测光顾和居高临下的语言
PALI-NLP at SemEval-2022 Task 4: Discriminative Fine-tuning of Transformers for Patronizing and Condescending Language Detection
摘要:
Patronizing and Condensing Language(PCL)具有很大的有害影响,并且对于人类法官和现有的NLP系统都难以检测。在SemEval-2022任务4中,我们提出了一种新的基于transformer的模型及其集成,以准确理解PCL检测的语言上下文。为了促进对PCL的微妙和主观性质的理解,两个微调策略被应用于捕捉不同的语言行为和分类分布的歧视性特征。该系统在官方排名中取得了显著的成绩,包括子任务1的第一名和子任务2的第五名。大量的实验任务证明了我们的系统和策略的有效性。
英文摘要:
Patronizing and condescending language (PCL) has a large harmful impact and is difficult to detect, both for human judges and existing NLP systems. At SemEval-2022 Task 4, we propose a novel Transformer-based model and its ensembles to accurately understand such language context for PCL detection. To facilitate comprehension of the subtle and subjective nature of PCL, two fine-tuning strategies are applied to capture discriminative features from diverse linguistic behaviour and categorical distribution. The system achieves remarkable results on the official ranking, including 1st in Subtask 1 and 5th in Subtask 2. Extensive experiments on the task demonstrate the effectiveness of our system and its strategies.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。