From LLMs to LRMs: Rethinking Pruning for Reasoning-Centric Models
从大语言模型到大推理模型:重新思考面向推理中心模型的剪枝
Longwei Ding, Anhao Zhao, Fanghua Ye, Ziyang Chen, Xiaoyu Shen
机构
*
Institute of Digital Twin, Eastern Institute of Technology(数字孪生研究院,东部技术研究所)
;
Department of Computing, The Hong Kong Polytechnic University(计算系,香港理工大学)
;
Tencent Hunyuan / AI Lab(腾讯文英/人工智能实验室)
;
Université Paris Dauphine - PSL(巴黎-萨克勒大学)
专题命中
推理与问题求解
:LLM(abstract);large language model(abstract);language model(abstract);分类 cs.LG
机构
*
Macquarie University(麦考瑞大学)
;
Bharati Vidyapeeth’s College Of Engineering(巴里蒂大学工程学院)
;
Vivekananda Institute of Professional Studies (VIPS)(维维kananda专业研究学院)
;
DSEU-Okhla
;
Center for SDGC(SDGC研究中心)
;
Stanford University(斯坦福大学)
;
Cornell University(康奈尔大学)
专题命中
推理与问题求解
:LLM(abstract);large language model(abstract);language model(abstract);分类 cs.CL
Far from the Shallow: Brain-Predictive Reasoning Embedding through Residual Disentanglement
远离浅层:通过残差解耦实现脑预测推理嵌入
Linyang He, Tianjun Zhong, Richard Antonello, Gavin Mischler, Micah Goldblum, Nima Mesgarani
机构
*
Zuckerman Mind Brain Behavior Institute, Columbia University(扎克曼脑行为研究所,哥伦比亚大学)
;
Department of Electrical Engineering, Columbia University(电气工程系,哥伦比亚大学)
;
Department of Computer Science, Columbia University(计算机科学系,哥伦比亚大学)
专题命中
推理与问题求解
:LLM(abstract);large language model(abstract);language model(abstract);分类 cs.CL
Spectral Logit Sculpting: Adaptive Low-Rank Logit Transformation for Controlled Text Generation
谱logit雕刻:一种自适应低秩logit变换用于受控文本生成
Jin Li, Zhebo Wang, Tianliang Lu, Mohan Li, Wenpeng Xing, Meng Han
机构
*
Zhejiang University(浙江大学)
;
Binjiang Institute of Zhejiang University(浙江大学滨江学院)
;
Hangzhou Dianzi University(杭州电子科技大学)
;
People’s Public Security University of China(中国人民公安大学)
;
Guangzhou University(广州大学)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.CL、cs.AI、cs.LG
Beyond Outcome Verification: Verifiable Process Reward Models for Structured Reasoning
超越结果验证:用于结构化推理的可验证过程奖励模型
Massimiliano Pronesti, Anya Belz, Yufang Hou
机构
*
IBM Research Europe - Ireland(IBM欧洲研究院-爱尔兰)
;
Dublin City University(都柏林城市大学)
;
IT:U Interdisciplinary Transformation University Austria(IT:U跨学科转型大学奥地利)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.CL、cs.AI
MemWeaver: Weaving Hybrid Memories for Traceable Long-Horizon Agentic Reasoning
MemWeaver: 为可追溯的长 horizon 代理推理编织混合记忆
Juexiang Ye, Xue Li, Xinyu Yang, Chengkai Huang, Lanshun Nie, Lina Yao, Dechen Zhan
机构
*
Harbin Institute of Technology(哈尔滨理工大学)
;
The University of New South Wales(新南威尔士大学)
;
Macquarie University(麦考瑞大学)
;
CSIRO’s Data61(澳大利亚联邦科学与工业研究组织Data61)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.CL
MiST: Understanding the Role of Mid-Stage Scientific Training in Developing Chemical Reasoning Models
MiST:理解中期科学训练在开发化学推理模型中的作用
Andres M Bran, Tong Xie, Shai Pranesh, Jeffrey Meng, Xuan Vu Nguyen, Jeremy Goumaz, David Ming Segura, Ruizhi Xu, Dongzhan Zhou, Wenjie Zhang, Bram Hoex, Philippe Schwaller
机构
*
Laboratory of Artificial Chemical Intelligence (LIAC), Institute of Chemical Sciences and Engineering (ISIC)(人工化学智能实验室(LIAC)、化学科学与工程研究所)
;
National Centre of Competence in Research (NCCR) Catalysis(催化研究国家级竞争力中心)
;
School of Photovoltaic and Renewable Energy engineering(光伏与可再生能源工程学院)
;
School of Computer Science and Engineering(计算机科学与工程学院)
;
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
;
Green Dynamics
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.LG
CommentsThe paper is withdrawn by the authors after discovering a flaw in the theoretical derivation presented in the Method section. This incorrect step leads to conclusions that are not supported by the corrected derivation. The authors plan to reconstruct the argument and will release an updated version once the issue is fully resolved
机构
*
Mohamed bin Zayed University of Artificial Intelligence(莫扎德·本·扎耶德人工智能大学)
;
Ubiquitous Knowledge Processing Lab (UKP Lab)(无处不在知识处理实验室)
;
Department of Computer Science(计算机科学系)
;
Hessian Center for AI (hessian.AI)(黑森人工智能中心)
;
Technische Universität Darmstadt(德累斯顿技术大学)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.CL
机构
*
Shanghai International Studies University(上海国际 Studies 大学)
;
East China Normal University(华东师范大学)
;
Huaiyin Normal University(淮阴师范学院)
;
City University of Macau(澳门城市大学)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.AI
SimWorld-Robotics: Synthesizing Photorealistic and Dynamic Urban Environments for Multimodal Robot Navigation and Collaboration
SimWorld-Robotics: 为多模态机器人导航与协作合成逼真动态城市环境
Yan Zhuang, Jiawei Ren, Xiaokang Ye, Jianzhi Shen, Ruixuan Zhang, Tianai Yue, Muhammad Faayez, Xuhong He, Ziqiao Ma, Lianhui Qin, Zhiting Hu, Tianmin Shu
机构
*
University of Virginia(弗吉尼亚大学)
;
UC San Diego(加州大学圣地亚哥分校)
;
Johns Hopkins University(约翰霍普金斯大学)
;
Carnegie Mellon University(卡内基梅隆大学)
;
University of Michigan(密歇根大学)
MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
MathMist: 一种用于数学问题解决和推理的平行多语言基准数据集
Mahbub E Sobhani, Md. Faiyaz Abdullah Sayeedi, Tasnim Mohiuddin, Md Mofijul Islam, Swakkhar Shatabda
机构
*
BRAC University(布拉克大学)
;
United International University(国际联合大学)
;
Qatar Computing Research Institute(卡塔尔计算研究所)
;
Center for Computational & Data Sciences, Independent University, Bangladesh(计算与数据科学中心,独立大学,孟加拉国)
;
Amazon GenAI(亚马逊生成人工智能)
;
University of Virginia(弗吉尼亚大学)
专题命中
推理与问题求解
:large language model(abstract);language model(abstract);分类 cs.CL