DeepSeek-V3.2: 推动开放大规模语言模型的前沿
DeepSeek-V3.2: Pushing the Frontier of Open Large Language Models
AI总结:
DeepSeek-V3.2通过高效注意力机制、强化学习框架和大规模代理任务合成流水线,在计算效率与推理能力上取得突破,超越GPT-5并获国际竞赛金牌。
摘要:
我们介绍了DeepSeek-V3.2,一个在高计算效率与优越推理和代理性能之间取得平衡的模型。DeepSeek-V3.2的关键技术突破包括:(1) DeepSeek稀疏注意力(DSA):我们引入了DSA,一种高效的注意力机制,显著减少了计算复杂度,同时在长上下文场景中保持模型性能。(2) 可扩展的强化学习框架:通过实施一个稳健的强化学习协议并扩展训练后的计算,DeepSeek-V3.2的表现与GPT-5相当。值得注意的是,我们的高性能变体DeepSeek-V3.2-Speciale超越了GPT-5,在推理能力上与Gemini-3.0-Pro相当,在2025年国际数学奥林匹克竞赛(IMO)和国际信息学奥林匹克竞赛(IOI)中均取得金牌成绩。(3) 大规模代理任务合成流水线:为了将推理整合到工具使用场景中,我们开发了一种新的合成流水线,系统地生成大规模训练数据。该方法促进了可扩展的代理训练后改进,在复杂的互动环境中实现了显著的泛化能力和指令遵循鲁棒性提升。
英文摘要:
We introduce DeepSeek-V3.2, a model that harmonizes high computational efficiency with superior reasoning and agent performance. The key technical breakthroughs of DeepSeek-V3.2 are as follows: (1) DeepSeek Sparse Attention (DSA): We introduce DSA, an efficient attention mechanism that substantially reduces computational complexity while preserving model performance in long-context scenarios. (2) Scalable Reinforcement Learning Framework: By implementing a robust reinforcement learning protocol and scaling post-training compute, DeepSeek-V3.2 performs comparably to GPT-5. Notably, our high-compute variant, DeepSeek-V3.2-Speciale, surpasses GPT-5 and exhibits reasoning proficiency on par with Gemini-3.0-Pro, achieving gold-medal performance in both the 2025 International Mathematical Olympiad (IMO) and the International Olympiad in Informatics (IOI). (3) Large-Scale Agentic Task Synthesis Pipeline: To integrate reasoning into tool-use scenarios, we developed a novel synthesis pipeline that systematically generates training data at scale. This methodology facilitates scalable agentic post-training, yielding substantial improvements in generalization and instruction-following robustness within complex, interactive environments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。