近年来,大规模语言模型(LLMs)的进步显著提升了自然语言处理(NLP)应用的效果。然而,这些模型往往继承并放大了训练数据中的偏差。尽管已有多个用于偏差检测的数据集,但大多数仅限于一到两个NLP任务,通常是分类或评估任务,且不提供在多样化任务设置中的广泛覆盖。为解决这一差距,我们引入了偏差跨领域评估(Bias Evaluations Across Domains,BEADs)数据集,旨在支持广泛的任务,包括文本分类、标记分类、偏差量化和无害语言生成。本工作的一项关键贡献是支持模型评估和监督训练的黄金标准标注方案。在最先进的模型上的实验揭示了一些差距:一些模型对特定人口群体存在系统性偏差,而其他模型在不同群体间应用安全护栏更加严格或不一致。总体而言,这些结果突显了当前模型的持续不足,并强调了全面偏差评估的必要性。项目:https://vectorinstitute.github.io/BEAD/ 数据:https://huggingface.co/datasets/shainar/BEAD
英文摘要:
Recent advances in large language models (LLMs) have substantially improved natural language processing (NLP) applications. However, these models often inherit and amplify biases present in their training data. Although several datasets exist for bias detection, most are limited to one or two NLP tasks, typically classification or evaluation and do not provide broad coverage across diverse task settings. To address this gap, we introduce the \textbf{Bias Evaluations Across Domains} (\textbf{B}\texttt{EADs}) dataset, designed to support a wide range of NLP tasks, including text classification, token classification, bias quantification, and benign language generation. A key contribution of this work is a gold-standard annotation scheme that supports both evaluation and supervised training of language models. Experiments on state-of-the-art models reveal some gaps: some models exhibit systematic bias toward specific demographics, while others apply safety guardrails more strictly or inconsistently across groups. Overall, these results highlight persistent shortcomings in current models and underscore the need for comprehensive bias evaluation. Project: https://vectorinstitute.github.io/BEAD/ Data: https://huggingface.co/datasets/shainar/BEAD
Ready to Translate, Not to Represent? Bias and Performance Gaps in Multilingual LLMs Across Language Families and Domains
United International University(国际联合大学);Qatar Computing Research Institute(卡塔尔计算研究所);Amazon GenAI(亚马逊生成人工智能);University of Virginia(弗吉尼亚大学);BRAC University(布拉克大学)
GUIDE: Resolving Domain Bias in GUI Agents through Real-Time Web Video Retrieval and Plug-and-Play Annotation
Shanghai Jiao Tong University(上海交通大学);State Key Laboratory for General Artificial Intelligence, BIGAI(通用人工智能国家重点实验室,北京通用人工智能研究院);Beijing Institute of Technology(北京理工大学)