AfriqueLLM: How Data Mixing and Model Architecture Impact Continued Pre-training for African Languages
AfriqueLLM: 数据混合与模型架构如何影响非洲语言的持续预训练
Hao Yu, Tianyi Xu, Michael A. Hedderich, Wassim Hamidouche, Syed Waqas Zamir, David Ifeoluwa Adelani
机构
*
McGill University(麦吉尔大学)
;
Mila-Quebec AI Institute(魁北克AI研究所)
;
LMU Munich & Munich Center for Machine Learning(慕尼黑大学及慕尼黑机器学习中心)
;
Microsoft AI for Good Research Lab(微软AI for Good研究实验室)
机构
*
DIRO & Institut Courtois, Université de Montréal(DIRO与Courtois研究所,蒙特利尔大学)
;
Mila – Québec AI Institute(魁北克人工智能研究所)
;
Microsoft Research(微软研究院)
;
Canada CIFAR AI Chair(加拿大CIFAR人工智能主席)
Ayush Noori, Aaron E. Boussina, Hai Ho Bich, James Anibal, Julia Maslinski, Manuel Burger, Martin Faltys, Adam Rodman, Alan Karthikesalingam, Alessandro Blasimme, Annelia Itwaru, Ben Kaplan, Bilal A. Mateen, Christopher A. Longhurst, Daniel Yang, Dave deBronkart, Effy Vayena, Fedor Sergeev, Gauden Galea, Ha Thi Hai Duong, Harold F. Wolf, Jacob Waxman, Joerg C. Schefold, Joshua C. Mandel, Juliana Rotich, Kenneth D. Mandl, Lily Poursoltan, Maryam Mustafa, Melissa Miles, Nigam H. Shah, Noa Dagan, Pavan Bodanki, Peter Lee, Philipp Koralus, Prathamesh Parchure, Prem Timsina, Ran D. Balicer, Robert Korom, Scott Mahoney, Seth Hain, Tien Yin Wong, Trevor Mundel, Vivek Natarajan, Ankit Sakhuja, Benjamin Glicksberg, C. Louise Thwaites, Gunnar Rätsch, Karandeep Singh, David A. Clifton, Isaac S. Kohane, Marinka Zitnik
机构
*
Harvard Medical School(哈佛医学院)
;
University of Oxford(牛津大学)
;
Institute for Ethics in AI(人工智能伦理研究所)
;
Cosmos Institute(宇宙研究所)
;
Harvard Medical School and Clalit Research Institute(哈佛医学院和Clalit研究机构)
;
University of California, San Diego(加州大学圣地亚哥分校)
;
Joan and Irwin Jacobs Center for Health Innovation(乔安和伊万·雅各布健康创新中心)
;
Oxford University Clinical Research Unit(牛津大学临床研究中心)
;
Icahn School of Medicine at Mount Sinai(辛格纳医学中心)
;
The Hasso Plattner Institute for Digital Health at Mount Sinai(辛格纳医学中心数字健康研究所)
;
ETH Zurich(苏黎世联邦理工学院)
;
University Hospital, University of Bern(伯恩大学医院)
;
Beth Israel Deaconess Medical Center(贝斯以色列医疗中心)
;
Google DeepMind(谷歌DeepMind)
;
The Mount Sinai AI Assurance Lab(辛格纳医学中心人工智能保证实验室)
;
University of Birmingham(伯明翰大学)
;
PATH(PATH组织)
;
Seattle Children’s Hospital(西雅图儿童医院)
;
Department of Pediatrics, University of California, San Diego(加州大学圣地亚哥分校儿科部)
;
Kaiser Foundation Health and Hospitals(凯撒基金会健康与医院)
;
e-Patient Dave, LLC(e-Patient Dave公司)
;
Regional Office for Europe, World Health Organization(世界卫生组织欧洲地区办公室)
;
University of Malta(马耳他大学)
;
Centre for Tropical Medicine and Global Health, University of Oxford(牛津大学热带医学与全球健康中心)
;
Healthcare Information and Management Systems Society(医疗信息与管理系统协会)
;
Clalit Research Institute, Innovation Division, Clalit Health Services(Clalit研究机构创新部门,Clalit健康服务)
;
Microsoft Research(微软研究院)
;
Gates Foundation(比尔及梅琳达·盖茨基金会)
;
Computational Health Informatics Program, Boston Children’s Hospital(波士顿儿童医院计算健康信息学项目)