We review the recent literature (January 2022- October 2024) in South Asian languages on text-based language processing, multimodal models, and speech processing, and provide a spotlight analysis focused on 21 low-resource South Asian languages, namely Saraiki, Assamese, Balochi, Bhojpuri, Bodo, Burmese, Chhattisgarhi, Dhivehi, Gujarati, Kannada, Kashmiri, Konkani, Khasi, Malayalam, Meitei, Nepali, Odia, Pashto, Rajasthani, Sindhi, and Telugu. We identify trends, challenges, and future research directions, using a step-wise approach that incorporates relevance classification and clustering based on large language models (LLMs). Our goal is to provide a breadth-first overview of the recent developments in South Asian language technologies to NLP researchers interested in working with South Asian languages.
Bhaasha, Bhasa, Zaban: A Survey for Low-Resourced Languages in South Asia -- Current Stage and Challenges
Dept of Computer Science & Engineering, West Bengal University of Technology(计算机科学与工程系,西孟加拉理工大学);Department of Computer Science, University of Memphis(计算机科学系,孟菲斯大学)
Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages
Brown University(布朗大学);UC Berkeley(加州大学伯克利分校);University of California, Los Angeles(加州大学洛杉矶分校);HKUST(香港科技大学);Bloomberg(彭博);EleutherAI;Samsung R&D Institute Philippines(三星菲律宾研发中心);Stanford University(斯坦福大学);National University of Singapore(新加坡国立大学);VietAI Research(VietAI研究院);University of Potsdam(波茨坦大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学)
SEA-CLIP-Tiny: Efficient Multilingual Text-Vision Embedding for Southeast Asian Languages
SEACrowd;University of Indonesia(印度尼西亚大学);Cohere Labs Community(Cohere Labs 社区);Technical University of Denmark(丹麦技术大学);Chulalongkorn University(朱拉隆功大学);Vidyasirimedhi Institute of Science and Technology(维迪亚西里梅迪科学技术研究所);AI Singapore(新加坡人工智能)
A Novel Interpretability Metric for Explaining Bias in Language Models: Applications on Multilingual Models from Southeast Asia
School of Computer Science, University of Birmingham(英国伯明翰大学计算机科学学院);Department of Information Systems and Computer Science, Ateneo de Manila University(马尼拉大学信息系统与计算机科学系)
LaoBench: A Large-Scale Multidimensional Lao Benchmark for Large Language Models
China-ASEAN Information Harbor Co., Ltd.(中国-东盟信息港有限公司);Beijing Academy of Artificial Intelligence(北京人工智能研究院);School of Software & Microelectronics, Peking University(北京大学软件与微电子学院)
SEA-BED: How Do Embedding Models Represent Southeast Asian Languages?
Vidyasirimedhi Institute of Science and Technology(威差亚西里梅迪科学技术研究所);AI Singapore(新加坡人工智能);King Mongkut’s Institute of Technology Ladkrabang(拉卡邦先皇理工学院);Nanyang Technological University(南洋理工大学);Department of Computer Engineering, Faculty of Engineering, Chulalongkorn University(朱拉隆功大学工程学院计算机工程系)
MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models
Islamic University of Technology(伊斯兰科技大学);South East University(东南大学);Vector Institute(矢量研究所);University of British Columbia(不列颠哥伦比亚大学);York University(约克大学)
Bhasacitra: Visualising the dialect geography of South Asia
Georgetown University(乔治城大学);San Mateo High School(圣马特奥高中);EFL University, Hyderabad(海得拉巴英语外语大学);University of North Carolina – Chapel Hill(北卡罗来纳大学教堂山分校)
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages
AI Singapore(新加坡人工智能中心);IndoNLP(印尼自然语言处理研究组);Universitas Indonesia(印度尼西亚大学);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);RevComm, Inc.(RevComm公司);Tohoku University(东北大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学);University of Bath(巴斯大学);National University Philippines(菲律宾国立大学);MOH Office for Healthcare Transformation (MOHT)(卫生部医疗转型办公室);NAIST(奈良科学技术研究所);Works Applications Lab(Works Applications实验室);Universitas Gadjah Mada(加查马达大学);Institut Teknologi Bandung(万隆理工学院);Beijing Academy of Artificial Intelligence (BAAI)(北京人工智能研究院);Institute for Infocomm Research, A*STAR(新加坡资讯通信研究院(新加坡科技研究局下属));Samsung Research Philippines(三星菲律宾研究院);University of Cambridge(剑桥大学);Queensland University of Technology(昆士兰科技大学)
Automatic Normalization of Word Variations in Code-Mixed Social Media Text
Language Technologies Research Centre (LTRC)(语言技术研究中心);Kohli Center on Intelligent Systems (KCIS)(科利智能系统中心);International Institute of Information Technology, Hyderabad(海得拉巴国际信息技术学院)
From Statistical Methods to Pre-Trained Models; A Survey on Automatic Speech Recognition for Resource Scarce Urdu Language
Shenzhen University(深圳大学);School of Artificial Intelligence, CAS Institute of Automation(中国科学院自动化研究所人工智能学院);University of Chinese Academy of Sciences(中国科学院大学)