Perceived gender inference from names is important for inclusive scientometrics research, yet existing methods perform poorly on non-Western scholars. We address this gap for Chinese names, which appear in two forms, Hanzi and Pinyin, its Romanized form (e.g., Zhang Wei, Li Na). In international bibliographic records, names are often available only in Pinyin. However, a single pinyin name can correspond to multiple distinct hanzi characters with different gender associations, so gender inference from Pinyin alone is intrinsically ambiguous. To address this, we first develop two hanzi models, a regression model that produces a continuous gender score from 0 (male) to 1 (female), and a classification model that outputs one of three labels (\em{male}, \em{neutral}, \em{female}). We train them on a sample of hanzi names from Chinese-language physics publications, rated by 11 native Chinese speakers. On this sample, the models achieve an RMSE of $0.09$ and an R$^2$ of $0.85$ (regression), and macro-AUC of $0.97$ and a Cohen's $κ$ of $0.81$ (classification), demonstrating high performance that is robust to class imbalance. For pinyin names, we propose a pipeline that aggregates hanzi predictions via transliteration and frequency weighting, together with an ambiguity score that flags names whose gender cannot be resolved from Pinyin alone. Benchmarked against three off-the-shelf tools (Namsor, GPT, and Claude), our models achieve the highest agreement with human annotations for both gender scores and gender labels, in both scripts. Applied to an independent sample of Chinese-named authors in APS journals, our models assign a gender to every name, whereas existing Pinyin-based methods leave between 20\% and 100\% of names unclassified. These findings demonstrate the importance of hanzi-level information for reliable gender inference of Chinese names. Code and data are publicly available.
CORGI-PM: A Chinese Corpus For Gender Bias Probing and Mitigation
Beijing Academy of Artificial Intelligence(北京人工智能研究院);The University of Sheffield(谢菲尔德大学);University of Michigan(密歇根大学);University of Colorado Boulder(科罗拉多大学博尔德分校);Sichuan University(四川大学);McGill University(麦吉尔大学)
AutoTail-BSFGM: Class-Balance-Aware Fine-Tuning for Chinese Scholarly Text Classification
Department of Intelligent Communication, School of Journalism and Communication, Minzu University of China(中国民族大学新闻与传播学院智能通信系);ZeeLin (Beijing) Technology Co., Ltd.(北京智联科技有限公司);School of Journalism and Communication, Tsinghua University(清华大学新闻与传播学院);College of AI, Tsinghua University(清华大学人工智能学院)
From Detection to Mitigation: Addressing Gender Bias in Chinese Texts via Efficient Tuning and Voting-Based Rebalancing
Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials(广东省量子工程与量子材料重点实验室);School of Electronic Science and Engineering (School of Microelectronics)(电子科学与工程学院(微电子学院));South China Normal University(华南师范大学);Guangdong Provincial Key Laboratory of Intelligent Information Processing(广东省智能信息处理重点实验室);School of Business(商学院);Yangzhou University(扬州大学)
Beyond Content: How Grammatical Gender Shapes Visual Representation in Text-to-Image Models
MBZUAI(穆罕默德·本·扎耶德人工智能大学);Vector Institute of AI(Vector人工智能研究所);University of Central Florida(中佛罗里达大学);University of British Columbia(不列颠哥伦比亚大学);Emory University(埃默里大学);Invertible AI
SLING: Sino Linguistic Evaluation of Large Language Models
UMass Amherst(马萨诸塞大学阿默斯特分校)
为了了解预训练的汉语语言模型(LM)编码了哪些语言知识,我们引入了汉语语言学(SLING)基准,它由38 K最小句子对组成,分为9个高级语言现象。每一对都展示了特定句法或语义现象的可接受性对比(例如,关键字丢失vs.关键字丢失),LM应该为可接受的句子分配较低的困惑度。与CLiMP数据集(Xiang et al.,2021),其中也包含中文最小对,并通过翻译英语BLiMP数据集的词汇创建,SLING中的最小对主要是通过对中文树库9.0中自然发生的语言学家注释的句子应用句法和词汇转换来获得的,从而解决了CLiMP数据生成过程中的严重问题。我们测试了18个公开的预训练单语(例如,BERT-base-zh,CPM)和多语言(例如,mT5,XLM)SLING上的语言模型。我们的实验表明,LM的平均准确率远远低于人类的表现(69.7%对97.1%),而BERT-base-zh在所有测试的LM中达到了最高的准确率(84.8%),甚至更大。此外,我们发现,大多数LM有很强的性别和数量(单/复数)的偏见,他们表现得更好的地方比层次的现象。
Auditing demographic bias in AI-based emergency police dispatch: a cross-lingual evaluation of eleven large language models
Department of Industrial Engineering, Tsinghua University(清华大学工业工程系);School of Social Sciences, Tsinghua University(清华大学社会科学部);Department of Industrial Engineering, Federal University of Rio de Janeiro(里约热内卢联邦大学工业工程系)
Bias in the Ear of the Listener: Assessing Sensitivity in Audio Language Models Across Linguistic, Demographic, and Positional Variations
Department of Computer Science and Information Engineering, National Taiwan University, Taiwan(国家台湾大学计算机科学与信息工程系);Institute of Information Science, Academia Sinica, Taiwan(台湾学术院信息科学研究所);AI Research Center (AINTU), National Taiwan University, Taiwan(国家台湾大学人工智能研究中心(AINTU))