Next Concept Prediction in Discrete Latent Space Leads to Stronger Language Models
在离散潜在空间中进行下一步概念预测可使语言模型更强大
Yuliang Liu, Yunchong Song, Yixuan Wang, Kewen Ge, Alex Lamb, Qipeng Guo, Kai Chen, Bowen Zhou, Zhouhan Lin
机构
*
LUMIA Lab(LUMIA实验室)
;
School of Artificial Intelligence(人工智能学院)
;
Shanghai Jiao Tong University(上海交通大学)
;
Shanghai AI Laboratory(上海人工智能实验室)
;
Department of Electronic Engineering(电子工程系)
;
College of Artificial Intelligence(人工智能学院)
;
Tsinghua University(清华大学)
;
Shanghai Innovation Institute(上海创新研究院)
FlattenGPT: Depth Compression for Transformer with Layer Flattening
FlattenGPT: Transformer中基于层扁平化的深度压缩
Ruihan Xu, Qingpei Guo, Yao Zhu, Xiangyang Ji, Ming Yang, Shiliang Zhang
机构
*
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(多媒体信息处理国家重点实验室,计算机科学学院,北京大学)
;
Tsinghua University(清华大学)
Guoqi Yu, Xiaowei Hu, Angelica I. Aviles-Rivero, Anqi Qiu, Shujun Wang
机构
*
PolyU
;
South China University of Technology(南方科技大学)
;
Tsinghua University(清华大学)
;
YMSC, Tsinghua University(清华大学交叉信息学院)
;
Dept. of Biomedical Engineering, PolyU(PolyU 生物医学工程系)
;
Sch. of Future Technology, South China University of Technology(南方科技大学未来技术学院)
;
Dept. of Health Technology and Informatics, PolyU(PolyU 健康技术与信息学系)
;
Dept. of Biomedical Engineering and the Dept. of Data Science and Artificial Intelligence, PolyU(PolyU 生物医学工程系和数据科学与人工智能系)
G-LNS: Generative Large Neighborhood Search for LLM-Based Automatic Heuristic Design
G-LNS:基于生成式大邻域搜索的LLM自动启发式设计
Baoyun Zhao, He Wang, Liang Zeng
机构
*
Software College, Northeastern University(东北大学软件学院)
;
International Centre for Theoretical Physics Asia-Pacific, University of Chinese Academy of Sciences(中国科学院大学国际理论物理亚太中心)
;
Taiji Laboratory for Gravitational Wave Universe, University of Chinese Academy of Sciences(中国科学院大学太极引力波宇宙实验室)
;
Tsinghua University(清华大学)
Game-Theoretic Co-Evolution for LLM-Based Heuristic Discovery
基于博弈论的LLM启发式发现共演化
Xinyi Ke, Kai Li, Junliang Xing, Yifan Zhang, Jian Cheng
机构
*
C2DL, Institute of Automation, Chinese Academy of Sciences(C2DL,自动化研究所,中国科学院)
;
School of Artificial Intelligence, University of Chinese Academy of Sciences(人工智能学院,中国科学院大学)
;
Tsinghua University(清华大学)
SearchAttack: Red-Teaming LLMs against Knowledge-to-Action Threats under Online Web Search
SearchAttack: 对知识到行动威胁下对LLM进行红队攻击
Yu Yan, Sheng Sun, Mingfeng Li, Zheming Yang, Chiwei Zhu, Fei Ma, Benfeng Xu, Min Liu, Qi Li
机构
*
Institute of Computing Technology, CAS(计算技术研究所,中国科学院)
;
University of Chinese Academy of Sciences(中国科学院大学)
;
People's Public Security University of China(中国人民公安大学)
;
University of Science and Technology of China(中国科学技术大学)
;
Guangdong Laboratory of Artificial Intelligence and Digital Economy(广东人工智能与数字经济实验室)
;
Tsinghua University(清华大学)
CommentsMisusing LLM-driven search for harmful information-seeking poses serious risks. We characterize its usability and impact through a comprehensive red-teaming and evaluation
China Regional 3km Downscaling Based on Residual Corrective Diffusion Model
基于残差校正扩散模型的中国区域3公里降尺度
Honglu Sun, Hao Jing, Zhixiang Dai, Sa Xiao, Wei Xue, Jian Sun, Qifeng Lu
机构
*
State Key Laboratory of Severe Weather Meteorological Science and Technology(severe weather meteorological science and technology state key laboratory)
;
CMA Earth System Modeling and Prediction Centre
;
NVIDIA
;
Tsinghua University
Building Egocentric Procedural AI Assistant: Methods, Benchmarks, and Challenges
构建第一人称程序化AI助手:方法、基准和挑战
Junlong Li, Huaiyuan Xu, Sijie Cheng, Kejun Wu, Kim-Hui Yap, Lap-Pui Chau, Yi Wang
机构
*
Department of EEE(电子工程系)
;
The Hong Kong Polytechnic University(香港理工大学)
;
RayNeo
;
Tsinghua University(清华大学)
;
Huazhong University of Science and Technology(华中科技大学)
;
Nanyang Technological University(南洋理工大学)
机构
*
Beijing Institute of Technology, Beijing, China(北京理工大学)
;
State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China(国家一般人工智能重点实验室)
;
Beijing University of Posts(北京邮电大学)
;
Tsinghua University, Beijing, China(清华大学)
;
Shenzhen MSU-BIT University, Shenzhen, China(深圳MSU-BIT大学)
机构
*
School of Computer Science and Engineering, Northeastern University(东北大学计算机科学与工程学院)
;
Department of Computer Science and Technology, Institute for AI, Tsinghua University(清华大学人工智能研究院计算机科学与技术系)
;
Microsoft Research Asia(微软亚洲研究院)
SafeLink: Safety-Critical Control Under Dynamic and Irregular Unsafe Regions
SafeLink: 在动态和不规则不安全区域下的安全关键控制
Songqiao Hu, Zidong Wang, Zeyi Liu, Zhen Shen, Xiao He
机构
*
Department of Automation, and the Institute for Embodied Intelligence and Robotics, Tsinghua University(自动化系,以及 embodied intelligence and robotics 研究所,清华大学)
;
Department of Computer Science, Brunel University London(计算机科学系,布鲁内尔大学伦敦分校)
;
State Key Laboratory of Multimodal Artificial Intelligence Systems, Beijing Engineering Research Center of Intelligent Systems and Technology, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,北京智能系统与技术工程研究中心,中国科学院自动化研究所)
SparseEval: Efficient Evaluation of Large Language Models by Sparse Optimization
SparseEval: 通过稀疏优化高效评估大语言模型
Taolin Zhang, Hang Guo, Wang Lu, Tao Dai, Shu-Tao Xia, Jindong Wang
机构
*
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件工程学院)
;
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
;
Microsoft Research Asia(微软亚洲研究院)
Orchestrating Attention: Bringing Harmony to the 'Chaos' of Neurodivergent Learning States
协调注意力:为神经多样性学习状态的‘混乱’带来和谐
Satyam Kumar Navneet, Joydeep Chandra, Yong Zhang
机构
*
Peoples' Friendship University of Russia (RUDN University)(俄罗斯人民友谊大学(RUDN大学))
;
Joint Institute for Nuclear Research(联合核子研究所)
;
Vrije Universiteit Amsterdam(阿姆斯特丹自由大学)
;
University of Skövde(斯德哥尔摩大学)
;
Independent Researcher(独立研究者)
;
BNRIST, Tsinghua University(北京理工大学)
机构
*
Shanghai AI Laboratory(上海人工智能实验室)
;
Tsinghua University(清华大学)
;
Harbin Institute of Technology(哈尔滨工业大学)
;
Shanghai Jiao Tong University(上海交通大学)
;
Institute of Automation(自动化研究所)
;
Fudan University(复旦大学)
;
High School Affiliated to Fudan University(复旦大学附属高中)
;
Renmin University of China(中国人民大学)
;
University of Washington(华盛顿大学)
TKG-Thinker: Towards Dynamic Reasoning over Temporal Knowledge Graphs via Agentic Reinforcement Learning
TKG-Thinker: 向通过代理强化学习实现动态推理的时序知识图谱迈进
Zihao Jiang, Miao Peng, Zhenyan Shan, Wenjie Xu, Ben Liu, Gong Chen, Ziqi Gao, Min Peng
机构
*
School of Computer Science, Wuhan University(武汉大学计算机学院)
;
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州))
;
School of Artificial Intelligence, Wuhan University(武汉大学人工智能学院)
;
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院)
Lookahead-then-Verify: Reliable Constrained Decoding for Diffusion LLMs under Context-Free Grammars
前瞻性验证:用于扩散大语言模型在无上下文自由文法下的可靠约束解码
Yitong Zhang, Yongmin Li, Yuetong Liu, Jia Li, Xiaoran Jia, Zherui Li, Ge Li
机构
*
College of AI, Tsinghua University(清华大学人工智能学院)
;
School of Computer Science, Peking University(北京大学计算机学院)
;
School of Computer Science and Engineering, Beihang University(北航计算机科学与工程学院)
;
School of Computer Science and Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院)
;
School of Computing, National University of Singapore(新加坡国立大学计算机学院)
Junze Wang, Lei Fan, Dezheng Zhang, Weipeng Jing, Donglin Di, Yang Song, Sidong Liu, Cong Cong
机构
*
University of Science and Technology Beijing(北京科技大学)
;
University of New South Wales(新南威尔士大学)
;
Northeast Forestry University(东北林业大学)
;
Tsinghua University(清华大学)
;
Macquarie University(麦考瑞大学)