跳出数据之外:低资源语言自动审核流程中的殖民偏见与系统性问题
Think Outside the Data: Colonial Biases and Systemic Issues in Automated Moderation Pipelines for Low-Resource Languages
AI总结:
本研究通过访谈22位专家,揭示低资源语言自动审核中的殖民偏见与系统性问题,并提出多利益相关方方案以加强本地能力、民主化数据访问。
摘要:
大多数社交媒体用户来自全球南方,有害内容通常以当地语言出现。然而,人工智能驱动的审核系统在处理这些地区使用的低资源语言时面临困难。通过对22位从事有害内容检测的人工智能专家进行半结构化访谈,这些专家涉及四种低资源语言:泰米尔语(南亚)、斯瓦希里语(东非)、马格里布阿拉伯语(北非)和克丘亚语(南美),我们考察了为这些语言构建自动审核工具时存在的系统性问题。我们的研究结果显示,除了数据稀缺之外,社会政治因素,如科技公司对用户数据的垄断以及对利润较低的全球南方市场审核投入不足,加剧了历史性的不平等。即使有更多数据可用,以英语为中心且数据密集型的语言模型和预处理技术设计也忽视了针对形态复杂、语言多样且代码混合的语言进行设计的必要性。我们认为,这些局限性不仅仅是“数据稀缺”造成的技术差距,而是反映了结构性不平等,其根源在于对非西方语言的殖民压制。我们讨论了多利益相关方方法,以加强当地研究能力、实现数据访问民主化,并支持语言感知的解决方案,从而改进低资源语言的自动审核。
英文摘要:
Most social media users come from the Global South, where harmful content usually appears in local languages. Yet, AI-driven moderation systems struggle with low-resource languages spoken in these regions. Through semi-structured interviews with 22 AI experts working on harmful content detection in four low-resource languages: Tamil (South Asia), Swahili (East Africa), Maghrebi Arabic (North Africa), and Quechua (South America)--we examine systemic issues in building automated moderation tools for these languages. Our findings reveal that beyond data scarcity, socio-political factors such as tech companies' monopoly on user data and lack of investment in moderation for low-profit Global South markets exacerbate historic inequities. Even if more data were available, the English-centric and data-intensive design of language models and preprocessing techniques overlooks the need to design for morphologically complex, linguistically diverse, and code-mixed languages. We argue these limitations are not just technical gaps caused by "data scarcity" but reflect structural inequities, rooted in colonial suppression of non-Western languages. We discuss multi-stakeholder approaches to strengthen local research capacity, democratize data access, and support language-aware solutions to improve automated moderation for low-resource languages.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。