The rapid development of large language models has revolutionized code intelligence in software development. However, the predominance of closed-source models has restricted extensive research and development. To address this, we introduce the DeepSeek-Coder series, a range of open-source code models with sizes from 1.3B to 33B, trained from scratch on 2 trillion tokens. These models are pre-trained on a high-quality project-level code corpus and employ a fill-in-the-blank task with a 16K window to enhance code generation and infilling. Our extensive evaluations demonstrate that DeepSeek-Coder not only achieves state-of-the-art performance among open-source code models across multiple benchmarks but also surpasses existing closed-source models like Codex and GPT-3.5. Furthermore, DeepSeek-Coder models are under a permissive license that allows for both research and unrestricted commercial use.
Populism Meets AI: Advancing Populism Research with LLMs
Mount St. Mary’s University(圣玛丽大学);German Institute for Global and Area Studies(全球与区域研究所);Princeton University(普林斯顿大学);University of California, Los Angeles(加州大学洛杉矶分校);University of Oxford(牛津大学);Diego Portales University(迪埃戈·波尔塔尔大学);ELTE Centre for Social Sciences(埃尔泰社会科学中心);Brigham Young University(Brigham Young 大学)
BAPPA: Benchmarking Agents, Plans, and Pipelines for Automated Text-to-SQL Generation
Center for Computational & Data Sciences, Independent University, Bangladesh(计算与数据科学中心,独立大学,孟加拉国);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Can DeepSeek Reason Like a Surgeon? An Empirical Evaluation for Vision-Language Understanding in Robotic-Assisted Surgery
The Chinese University of Hong Kong(香港中文大学);University of Strasbourg(斯特拉斯堡大学);CNRS(法国国家科学研究中心);INSERM(法国国家健康与医学研究院);ICube(ICube实验室);IHU Strasbourg(斯特拉斯堡大学医院研究所)
SimLLM: Fine-Tuning Code LLMs for SimPy-Based Queueing System Simulation
Institute of Statistics and Big Data, Renmin University of China(中国人民大学统计与大数据研究院);School of Information, Renmin University of China(中国人民大学信息学院);School of Management and Economics, University of Electronic Science and Technology of China(电子科技大学管理学院)
Reranking Laws for Language Generation: A Communication-Theoretic Perspective
Instituto Superior Técnico, Universidade de Lisboa(里斯本大学高等技术学院);Instituto de Telecomunicações(电信研究所);TU Darmstadt(达姆施塔特工业大学);ELLIS Unit Lisbon(欧洲卓越学习系统里斯本单元);Unbabel(昂巴贝尔公司)
Lean Meets Theoretical Computer Science: Scalable Synthesis of Theorem Proving Challenges in Formal-Informal Pairs
D-CHAB, ETH Zurich, Zurich, Switzerland.;D-INFK, ETH Zurich, Zurich, Switzerland.;ETH AI Center, Zurich, Switzerland.;University of Pennsylvania, PA, USA.;Independent Researcher.
Let the Code LLM Edit Itself When You Edit the Code
National Key Laboratory of General Artificial Intelligence(通用人工智能国家重点实验室);School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);ByteDance Inc.(字节跳动公司)
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories
School of Computer Science, Peking University(北京大学计算机学院);Key Laboratory of High Confidence Software Technologies (Peking University), Ministry of Education(教育部高可信软件技术重点实验室(北京大学))
RefactorCoderQA: Benchmarking LLMs for Multi-Domain Coding Question Solutions in Cloud and Edge Deployment
York University and Algoma University(约克大学和阿尔戈马大学);Algoma University(阿尔戈马大学);Department of Systems and Computer Engineering, Carleton University(系统与计算机工程系,卡尔顿大学);Department of Math and Computer Science, Brandon University(数学与计算机科学系,布兰登大学)
Large Language Models as Code Executors: An Exploratory Study
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Xinjiang University(新疆大学);University of Melbourne(墨尔本大学);Tsinghua University(清华大学);Shanghai Jiao Tong University(上海交通大学);IBM Research(IBM研究院);Nantong University(南通大学);Alibaba(阿里巴巴)
Exploring Large Language Models in Resolving Environment-Related Crash Bugs: Localizing and Repairing
Department of Computer Science, Fudan University(复旦大学计算机科学系);School of Software Engineering, Sun Yat-sen University(中山大学软件学院);Institute for Clarity in Documentation(文档清晰研究所);Inria Paris-Rocquencourt(巴黎-鲁西永研究所);Rajiv Gandhi University(拉朱·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒尔研究实验室)
LR^2Bench: Evaluating Long-chain Reflective Reasoning Capabilities of Large Language Models via Constraint Satisfaction Problems
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongguancun Academy(中关村学院);Wuhan AI Research(武汉人工智能研究院)
Enhancing the Non-Functional Quality Compliance of LLM-Generated Code through Quality-Aware Preference Learning
School of Computer Science and Technology, Harbin Institute of Technology(哈尔滨工业大学计算机科学与技术学院);School of Computing and Information Systems, Singapore Management University(新加坡管理大学计算与信息系统学院)
ASMA-Tune: Unlocking LLMs' Assembly Code Comprehension via Structural-Semantic Instruction Tuning
Nankai University(南开大学);Zhejiang University(浙江大学);Ant Group(蚂蚁集团);Renmin University of China(中国人民大学);University of the Chinese Academy of Sciences(中国科学院大学)
A Study on the Impact of Natural Language Differences in Prompts on Automatic Code Generation Using LLMs
Kyushu University(九州大学);Eindhoven University of Technology(埃因霍温理工大学);Tianjin University(天津大学);Waseda University(早稻田大学);Inamori Research Institute for Science(稻盛科学研究所)
SemGuard: Real-Time Semantic Evaluator for Correcting LLM-Generated Code
Shandong Normal University(山东师范大学);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);Key Lab of HCST (PKU), MOE(教育部复杂系统管理与控制重点实验室(北京大学))