We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla-70B and PaLM-540B. We release all our models to the research community.
The University of Hong Kong(香港大学);ARC Lab, Tencent PCG(腾讯平台与内容事业群ARC实验室);Shanghai Jiao Tong University(上海交通大学);Beijing Language and Culture University(北京语言大学)
提出基于 Transformer 块扩展的后预训练方法,仅用新语料微调扩展块以避免灾难性遗忘,构建的 LLaMA Pro 在编程和数学等任务上表现卓越,为高级语言智能体奠定基础。
Extrapolating Large Language Models to Non-English by Aligning Languages
Nanjing University(南京大学);Peking University(北京大学);Shanghai AI Lab(上海人工智能实验室);The University of Hong Kong(香港大学);University of California, Santa Barbara(加州大学圣巴巴拉分校)
Radiology-Llama2: Best-in-Class Large Language Model for Radiology
University of Georgia(佐治亚大学);Harvard University(哈佛大学);Second Xiangya Hospital(中南大学湘雅二医院);Northwestern Polytechnical University(西北工业大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);University of Texas at Arlington(德克萨斯大学阿灵顿分校);Mayo Clinic(梅奥诊所);ShanghaiTech University(上海科技大学);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究中心)
LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training
Soochow University(苏州大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Fudan University(复旦大学);The Chinese University of Hong Kong(香港中文大学)
Feedback Indicators: The Alignment between Llama and a Teacher in Language Learning
Humboldt-Universität zu Berlin Department of Computer Science(柏林洪堡大学计算机科学系);Humboldt-Universität zu Berlin Language Centre(柏林洪堡大学语言中心);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
BigTranslate: Augmenting Large Language Models with Multilingual Translation Capability over 100 Languages
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Wuhan AI Research(武汉人工智能研究院)
ChatDoctor: A Medical Chat Model Fine-Tuned on a Large Language Model Meta-AI (LLaMA) Using Medical Domain Knowledge
University of Texas Southwestern Medical Center(德克萨斯大学西南医学中心);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);The Ohio State University(俄亥俄州立大学)
Evolution of meta's llama models and parameter-efficient fine-tuning of large language models: a survey
University of Kurdistan(库尔德斯坦大学);Queen Mary University(女王玛丽大学);Torrens University Australia(澳大利亚托伦斯大学);University of Technology Sydney(悉尼技术大学);University of Kurdistan Sanandaj, Iran(伊朗桑和杰德大学);TU Dortmund University(多特蒙德技术大学);University of Kurdistan Hewler(库尔德斯坦大学海勒);Tehran University(德黑兰大学)
OncoGPT: A Medical Conversational Model Tailored with Oncology Domain Expertise on a Large Language Model Meta-AI (LLaMA)
Shenzhen Kanghua Juntai Biotech Co. Ltd.(深圳康华君泰生物科技有限公司);University of California, Davis(加利福尼亚大学戴维斯分校);The First Affiliated Hospital of Jinan University(暨南大学附属第一医院)
Assessing Large Language Models for Medical QA: Zero-Shot and LLM-as-a-Judge Evaluation
Department of Computer Science and Engineering, Islamic University of Technology, Gazipur, Bangladesh(计算机科学与工程系,伊斯兰技术大学,加兹ipur,孟加拉国);Department of Computer Science(计算机科学系);Engineering, Islamic University of Technology, Gazipur, Bangladesh(工程,伊斯兰技术大学,加兹ipur,孟加拉国)
Efficient Training of Robust Traditional Chinese LLaMA-1B on a Single Consumer GPU: Continual Pre-training, SFT, and DPO
National Tsing Hua University(台湾清华大学);Accton Technology Corporation(智邦科技公司);National Yang Ming Chiao Tung University(阳明交通大学);University of Taipei(台北市立大学)
Information Extraction from Clinical Notes: Are We Ready to Switch to Large Language Models?
McWilliams School of Biomedical Informatics, The University of Texas Health Science Center at Houston(德克萨斯大学休斯顿健康科学中心麦克威廉姆斯生物医学信息学学院);Yale School of Medicine, Yale University(耶鲁大学医学院)