Large language models (LLMs) have received a lot of attention in natural language processing (NLP) research because of their exceptional performance in understanding and generating human languages. However, low-resource languages are left behind due to the unavailability of resources. In this work, we focus on enhancing the LLaMA-2-Amharic model by integrating task-specific and generative datasets to improve language model performance for Amharic. We compile an Amharic instruction fine-tuning dataset and fine-tuned LLaMA-2-Amharic model. The fine-tuned model shows promising results in different NLP tasks. We open-source our dataset creation pipeline, instruction datasets, trained models, and evaluation outputs to promote language-specific studies on these models.
The University of Hong Kong（香港大学）；ARC Lab, Tencent PCG（腾讯平台与内容事业群ARC实验室）；Shanghai Jiao Tong University（上海交通大学）；Beijing Language and Culture University（北京语言大学）
提出基于 Transformer 块扩展的后预训练方法，仅用新语料微调扩展块以避免灾难性遗忘，构建的 LLaMA Pro 在编程和数学等任务上表现卓越，为高级语言智能体奠定基础。
Language Diversity: Evaluating Language Usage and AI Performance on African Languages in Digital Spaces
Carnegie Mellon University（卡内基梅隆大学）；Africa Kigali Rwanda（非洲基加利卢旺达）；Bahir Dar Institute of Technology（巴希尔达尔技术学院）；Federal University Otuoke Bayelsa Nigeria（贝莱萨州联邦大学）
Advancing Tool-Augmented Large Language Models: Integrating Insights from Errors in Inference Trees
National Key Laboratory for Novel Software Technology（计算机软件新技术国家重点实验室）；School of Artificial Intelligence, Nanjing University（南京大学人工智能学院）；Alibaba International Digital Commerce（阿里巴巴国际数字商业集团）；Pazhou Laboratory (Huangpu)（琶洲实验室（黄埔））
Integrating Chain-of-Thought and Retrieval Augmented Generation Enhances Rare Disease Diagnosis from Clinical Notes
Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children's Hospital of Philadelphia（费城儿童医院雷蒙德·G·佩雷尔曼细胞与分子治疗中心）；University of Pennsylvania（宾夕法尼亚大学）；Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）
HPC-GPT: Integrating Large Language Model for High-Performance Computing
University of California, Merced（加州大学默塞德分校）；Argonne National Laboratory（阿贡国家实验室）；Iowa State University（爱荷华州立大学）；Lawrence Livermore National Laboratory（劳伦斯利弗莫尔国家实验室）；Binghamton University（宾汉姆顿大学）
LLaMA-Omni2: LLM-based Real-time Spoken Chatbot with Autoregressive Streaming Speech Synthesis
Key Laboratory of Intelligent Information Processing Institute of Computing Technology, Chinese Academy of Sciences (ICT/CAS)（智能信息处理重点实验室，计算技术研究所，中国科学院）；Key Laboratory of AI Safety, Chinese Academy of Sciences（人工智能安全重点实验室，中国科学院）；University of Chinese Academy of Sciences, Beijing, China（中国科学院大学，北京，中国）
SmoothRot: Combining Channel-Wise Scaling and Rotation for Quantization-Friendly LLMs
Doctoral School of Applied Informatics and Applied Mathematics, Obuda University（应用信息学与应用数学博士学院，奥布达大学）；John von Neumann Faculty of Informatics, Obuda University（约翰·冯·诺依曼信息学院，奥布达大学）
Integrating UMLS Knowledge into Large Language Models for Medical Question Answering
National University of Singapore（新加坡国立大学）；Duke-NUS Medical School（杜克-新加坡国立大学医学院）；University of Tokyo（东京大学）；National Institute of Advanced Industrial Science and Technology（日本产业技术综合研究所）；Singapore General Hospital（新加坡中央医院）；Zhejiang Lab（之江实验室）；National Institutes of Health（美国国立卫生研究院）；Yale University（耶鲁大学）
Enhancing Test-Time Scaling of Large Language Models with Hierarchical Retrieval-Augmented MCTS
The Ohio State University（俄亥俄州立大学）；Case Western Reserve University（凯斯西储大学）；Duke University（杜克大学）；University of Hong Kong（香港大学）；City University of Hong Kong（香港城市大学）；ByteDance（字节跳动）
From Fragments to Facts: A Curriculum-Driven DPO Approach for Generating Hindi News Veracity Explanations
TCS Research（TCS研究）；Department of Computer Science and Engineering, Indian Institute of Technology Patna（印度理工学院帕纳布计算机科学与工程系）；Indian Institute of Technology Patna（印度理工学院帕纳布）；University of Innsbruck（因斯布鲁克大学）
Heuristics and Biases in AI Decision-Making: Implications for Responsible AGI
Golisano Institute for Sustainability Rochester Institute of Technology Rochester, The United States；Information Sciences \& Technology, CEHC University at Albany, SUNY Albany, The United States
Integrating Expert Knowledge into Logical Programs via LLMs
Multimedia Systems Department, Gdansk University of Technology, Poland（格但斯克技术大学多媒体系统系，波兰）；Department of Computer Science, University of Manchester, United Kingdom（曼彻斯特大学计算机科学系，英国）；National Biomarker Centre (NBC), CRUK Manchester Institute, United Kingdom（英国CRUK曼彻斯特研究所国家生物标记中心）；Idiap Research Institute, Martigny, Switzerland（瑞士马尔蒂尼Idiap研究所）
LIFT: Improving Long Context Understanding Through Long Input Fine-Tuning
Institute for Artificial Intelligence, Peking University（北京大学人工智能研究院）；National Key Laboratory of General Artificial Intelligence, BIGAI（BIGAI通用人工智能全国重点实验室）
LIBRA: Measuring Bias of Large Language Model from a Local Context
School of Computer Science, University of Auckland（奥克兰大学计算机科学学院）；The Liggins Institute, University of Auckland（奥克兰大学利金斯研究所）；Research Centre for Māori Health and Development, Massey University（梅西大学毛利人健康与发展研究中心）
Large Language Model Enhanced Particle Swarm Optimization for Hyperparameter Tuning for Deep Learning Models
Division of Information and Computing Technology, College of Science and Engineering, Hamad Bin Khalifa University（哈马德·本·卡西姆大学信息与计算技术学院）；College of Medicine, Howard University（霍华德大学医学院）；Department of Computer Science and Engineering, Qatar University（卡塔尔大学计算机科学与工程系）
