Next Concept Prediction in Discrete Latent Space Leads to Stronger Language Models
在离散潜在空间中进行下一步概念预测可使语言模型更强大
Yuliang Liu, Yunchong Song, Yixuan Wang, Kewen Ge, Alex Lamb, Qipeng Guo, Kai Chen, Bowen Zhou, Zhouhan Lin
机构
*
LUMIA Lab(LUMIA实验室)
;
School of Artificial Intelligence(人工智能学院)
;
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Department of Electronic Engineering(电子工程系)
;
College of Artificial Intelligence(人工智能学院)
;
Tsinghua University(清华大学)
;
Shanghai Innovation Institute(上海创新研究院)
机构
*
University of Science(科学技术大学)
;
The Chinese University of Hong Kong(香港中文大学)
;
Peking University(北京大学)
;
Nanjing University(南京大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Shanghai Jiao Tong University(上海交通大学)
ProjDevBench: Benchmarking AI Coding Agents on End-to-End Project Development
ProjDevBench: 从端到端项目开发角度评估AI编程代理
Pengrui Lu, Shiqi Zhang, Yunzhong Hou, Lyumanshan Ye, Chaoyi Huang, Zixi Chen, Ji Zeng, Hantao Jiang, Pengfei Liu, Yiwei Wang, Ming-Hsuan Yang
机构
*
Shanghai Jiao Tong University, Shanghai, China(上海交通大学)
;
Beijing Institute of Technology, Beijing, China(北京理工大学)
;
University of California, Merced, CA, USA(加州大学默塞德分校)
;
Shanghai Innovation Institute, Shanghai, China(上海创新研究院)
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Nanjing University(南京大学)
;
Donghua University(东华大学)
;
The Chinese University of Hong Kong(香港中文大学)
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
WeChat Vision, Tencent Inc.(腾讯微信视觉部门)
;
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究所)
;
Hong Kong University of Science and Technology(香港科学大学)
;
Zhejiang University(浙江大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
机构
*
Shanghai Key Laboratory of Scalable Computing(可扩展计算与系统上海市重点实验室)
;
School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院)
;
SJTU Paris Elite Institute of Technology(上海交通大学巴黎精英技术学院)
;
ByteDance Inc.(字节跳动公司)
机构
*
Shanghai AI Laboratory(上海人工智能实验室)
;
Tsinghua University(清华大学)
;
Harbin Institute of Technology(哈尔滨工业大学)
;
Shanghai Jiao Tong University(上海交通大学)
;
Institute of Automation(自动化研究所)
;
Fudan University(复旦大学)
;
High School Affiliated to Fudan University(复旦大学附属高中)
;
Renmin University of China(中国人民大学)
;
University of Washington(华盛顿大学)
机构
*
Shenzhen Polytechnic University(深圳职业技术大学)
;
Fujitsu Research and Development Center Company Ltd.(富士通研发有限公司)
;
Beijing Jiaotong University(北京交通大学)
;
South China University of Technology(华南理工大学)
;
Shandong University(山东大学)
;
EVERSPRY
;
Wuhan University of Technology(武汉理工大学)
;
Sun Yat-sen University(中山大学)
;
Shanghai Jiao Tong University(上海交通大学)
;
Fujitsu Ltd.(富士通株式会社)
;
Huazhong University of Science and Technology(华中科技大学)
;
Hefei University of Technology(合肥工业大学)
;
Peking University, Shenzhen Graduate School(北京大学深圳研究生院)
;
Beijing Normal University(北京师范大学)
;
Watrix Technology Limited Co. Ltd.(华智科技有限公司)
;
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
;
University of Cordoba(科尔多瓦大学)
;
University of East London(东伦敦大学)
;
Southern University of Science and Technology(南方科技大学)
机构
*
Institute of Artificial Intelligence (TeleAI), China Telecom(人工智能研究院(TeleAI),中国电信)
;
Shanghai Jiao Tong University(上海交通大学)
;
East China University of Science and Technology(东华大学)
机构
*
Institute of Image Communication and Network Engineering, Shanghai Jiao Tong University(上海交通大学图像通信与网络工程研究所)
;
School of Communication and Electronic Engineering, East China Normal University(东华大学通信与电子工程学院)
;
School of Computer Science and Technology, East China Normal University(东华大学计算机科学与技术学院)
;
Shanghai AI Lab(上海人工智能实验室)
机构
*
School of Engineering, Westlake University(西湖大学工程学院)
;
Global College, Shanghai Jiao Tong University(上海交通大学全球学院)
;
Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院)
;
Department of Geotechnical Engineering, Tongji University(同济大学地质工程系)
;
School of Physics, Peking University(北京大学物理学院)
;
Key Laboratory for Power Machinery and Engineering of M. O. E., Shanghai Jiao Tong University(上海交通大学机械工程重点实验室)
Collaborative-Online-Learning-Enabled Distributionally Robust Motion Control for Multi-Robot Systems
协同在线学习赋能的分布鲁棒多机器人运动控制
Chao Ning, Han Wang, Longyan Li, Yang Shi
机构
*
School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, China(自动化与智能感知学院,上海交通大学,上海,中国)
;
Department of Mechanical Engineering, University of Victoria, Victoria, Canada(机械工程系,维多利亚大学,维多利亚,加拿大)
MAMBO-G: Magnitude-Aware Mitigation for Boosted Guidance
MAMBO-G:基于幅度的提升引导抑制
Shangwen Zhu, Qianyu Peng, Zhilei Shu, Yuting Hu, Zhantao Yang, Han Zhang, Zhao Pu, Andy Zheng, Xinyu Cui, Jian Zhao, Ruili Feng, Fan Cheng
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
The University of Hong Kong(香港大学)
;
University of Science and Technology of China(中国科学技术大学)
;
University of Waterloo(滑铁卢大学)
;
Chinese Academy of Sciences(中国科学院)
;
Zhongguancun Academy(中关村学院)
机构
*
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
;
SKL-IOTSC, CIS, University of Macau(澳门大学SKL-IOTSC、CIS)
;
Huazhong University of Science and Technology(华中科技大学)
;
The Chinese University of Hong Kong(香港中文大学)
机构
*
MoE Key Laboratory of Brain-inspired Intelligent Perception and Cognition, University of Science and Technology of China(脑启发智能感知与认知教育部重点实验室,中国科学技术大学)
;
Singapore University of Technology and Design(新加坡科技设计大学)
;
Alibaba Group(阿里巴巴集团)
;
Department of Computer Science and Engineering, Shanghai Jiao Tong University(上海交通大学计算机科学与工程系)