Soyoung An, Kyunghoon Bae, Eunbi Choi, Stanley Jungkyu Choi, Yemuk Choi, Seokhee Hong, Yeonjung Hong, Junwon Hwang, Hyojin Jeon, Gerrard Jeongwon Jo, Hyunjik Jo… 展开作者
Soyoung An, Kyunghoon Bae, Eunbi Choi, Stanley Jungkyu Choi, Yemuk Choi, Seokhee Hong, Yeonjung Hong, Junwon Hwang, Hyojin Jeon, Gerrard Jeongwon Jo, Hyunjik Jo, Jiyeon Jung, Yountae Jung, Euisoon Kim, Hyosang Kim, Joonkee Kim, Seonghwan Kim, Soyeon Kim, Sunkyoung Kim, Yireun Kim, Youchul Kim, Edward Hwayoung Lee, Haeju Lee, Honglak Lee, Jinsik Lee, Kyungmin Lee, Moontae Lee, Seungjun Lee, Woohyung Lim, Sangha Park, Sooyoun Park, Yongmin Park, Boseong Seo, Sihoon Yang, Heuiyeen Yeen, Kyungjae Yoo, Hyeongu Yun
我们介绍了EXAONE 3.0指令微调语言模型,这是由LG AI Research开发的大型语言模型(LLMs)家族中的首个开源模型。在不同模型规模中,我们公开发布了7.8B指令微调模型以促进开放研究和创新。通过在广泛公开和内部基准上的大量评估,EXAONE 3.0在与类似规模的其他最先进的开源模型相比,在现实世界性能和遵循指令能力方面表现出高度竞争力。我们的比较分析显示,EXAONE 3.0在韩语方面尤为突出,同时在一般任务和复杂推理上也取得了令人满意的性能。凭借其强大的现实世界效果和双语能力,我们希望EXAONE能继续推动专家AI的发展。我们的EXAONE 3.0指令微调模型可在https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct上获得。
英文摘要:
We introduce EXAONE 3.0 instruction-tuned language model, the first open model in the family of Large Language Models (LLMs) developed by LG AI Research. Among different model sizes, we publicly release the 7.8B instruction-tuned model to promote open research and innovations. Through extensive evaluations across a wide range of public and in-house benchmarks, EXAONE 3.0 demonstrates highly competitive real-world performance with instruction-following capability against other state-of-the-art open models of similar size. Our comparative analysis shows that EXAONE 3.0 excels particularly in Korean, while achieving compelling performance across general tasks and complex reasoning. With its strong real-world effectiveness and bilingual proficiency, we hope that EXAONE keeps contributing to advancements in Expert AI. Our EXAONE 3.0 instruction-tuned model is available at https://huggingface.co/LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct.
Merging Triggers, Breaking Backdoors: Defensive Poisoning for Instruction-Tuned Language Models
Graduate School of Artificial Intelligence, POSTECH, Republic of Korea(POSTECH人工智能研究生院,韩国);Department of Computer Science and Engineering, POSTECH, Republic of Korea(POSTECH计算机科学与工程系,韩国)
Nilekani Centre at AI4Bharat(AI4Bharat的Nilekani中心);IIIT D&M Kancheepuram(坎奇普兰IIIT D&M);Flipkart;University of Surrey(萨里大学);A * STAR(新加坡科技研究局);IIT Madras(马德拉斯印度理工学院);NICT(日本国立信息通信技术研究所);IBM Research(IBM研究院);Microsoft(微软)
Jailbreak Instruction-Tuned LLMs via end-of-sentence MLP Re-weighting
Peking University(北京大学);School of Science(理学院);Westlake University(西湖大学);Beijing International Center for Mathematical Research(北京国际数学研究中心);Center for Machine Learning Research(机器学习研究中心)
BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing
Manning College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校曼宁信息与计算机科学学院);University of Massachusetts Medical School(马萨诸塞大学医学院);Miner School of Computer and Information Sciences, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校迈纳计算机与信息科学学院);VA Bedford Health Care(贝德福德退伍军人保健中心)
Mind the Gap: Conformative Decoding to Improve Output Diversity of Instruction-Tuned Large Language Models
School of Computing University of Kent(肯特大学计算机学院);Leiden Institute of Advanced Computer Science Universiteit Leiden(莱顿先进计算机科学研究所);Cheriton School of Computer Science University of Waterloo(滑铁卢大学查里顿计算机科学学院)
AlpaCare:Instruction-tuned Large Language Models for Medical Application
University of California, Santa Barbara(加州大学圣巴巴拉分校);Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院北京协和医学院);University of Maryland, College Park(马里兰大学帕克分校)
From Templates to Natural Language: Generalization Challenges in Instruction-Tuned LLMs for Spatial Reasoning
Computational Linguistics, Department of Linguistics University of Potsdam(乌特雷赫特大学语言学系计算语言学部);German Research Center for Artificial Intelligence (DFKI), Berlin(德国人工智能研究中心(DFKI)柏林)
Building Instruction-Tuning Datasets from Human-Written Instructions with Open-Weight Large Language Models
Department of Computer Science, School of Computing, Institute of Science Tokyo(计算机科学系、计算学院、科学东京研究所);National Institute of Advanced Industrial Science and Technology(国家先进工业科学与技术研究院);Research and Development Center for Large Language Models, NII(大型语言模型研究与开发中心、日本科学振兴会)
X-Instruction: Aligning Language Model in Low-resource Languages with Self-curated Cross-lingual Instructions
State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Institute of Automation, CAS(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Empowering Persian LLMs for Instruction Following: A Novel Dataset and Training Approach
Isfahan University of Technology(伊斯法罕理工大学);Shahid Bahonar University of Kerman(克尔曼沙希德·巴霍纳尔大学);University of Tehran(德黑兰大学);Hunter College, City University of New York(纽约市立大学亨特学院)