In this paper we present the multilingual language model BLOOM-zh that features enhanced support for Traditional Chinese. BLOOM-zh has its origins in the open-source BLOOM models presented by BigScience in 2022. Starting from released models, we extended the pre-training of BLOOM by additional 7.4 billion tokens in Traditional Chinese and English covering a variety of domains such as news articles, books, encyclopedias, educational materials as well as spoken language. In order to show the properties of BLOOM-zh, both existing and newly created benchmark scenarios are used for evaluating the performance. BLOOM-zh outperforms its predecessor on most Traditional Chinese benchmarks while maintaining its English capability. We release all our models to the research community.
PluraMath: Extending Mathematical Reasoning Evaluation Beyond High-Resource Languages
Technical University of Munich(慕尼黑技术大学);Munich Center for Machine Learning(慕尼黑机器学习中心);Munich Data Science Institute(慕尼黑数据科学研究所);Applied AI Institute(应用人工智能研究所);Charles University(查尔斯大学);Nazarbayev University(纳扎尔拜大学);Inria(法国国家信息与自动化研究所);Indian Institute of Technology, Kharagpur (IIT Kharagpur)(印度Kharagpur理工学院);German University of Digital Science(德国数字科学大学)
OCNLI: Original Chinese Natural Language Inference
Indiana University, Bloomington(印第安纳大学伯明顿分校);Allen Institute for Artificial Intelligence, Seattle(艾伦人工智能研究所);Chinese Language Understanding Evaluation (CLUE) benchmark(中文语言理解评估(CLUE)基准测试(注:CLUE作为一个基准测试,严格来说不属于机构,但根据提取范围,此处明确出现作者单位,按要求提取))
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Wuhan AI Research(武汉人工智能研究院)
Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages
Brown University(布朗大学);UC Berkeley(加州大学伯克利分校);University of California, Los Angeles(加州大学洛杉矶分校);HKUST(香港科技大学);Bloomberg(彭博);EleutherAI;Samsung R&D Institute Philippines(三星菲律宾研发中心);Stanford University(斯坦福大学);National University of Singapore(新加坡国立大学);VietAI Research(VietAI研究院);University of Potsdam(波茨坦大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学)
Automating Dataset Updates Towards Reliable and Timely Evaluation of Large Language Models
Singapore Management University(新加坡管理大学);Fudan University(复旦大学);Tsinghua University(清华大学);Beijing Institute of Technology(北京理工大学);University of Science and Technology of China(中国科学技术大学);University of Georgia(佐治亚大学);Skywork AI(天工智芯(Skywork AI))
HKCanto-Eval: A Benchmark for Evaluating Cantonese Language Understanding and Cultural Comprehension in LLMs
Kyushu University(九州大学);hon9kon9ize;The Education University of Hong Kong(香港教育大学);The University of Hong Kong(香港大学);Independent Researcher(独立研究者);Votee AI;Beever AI