Pre-trained language models (LMs) are able to perform complex reasoning without explicit fine-tuning. To understand how pre-training with a next-token prediction objective contributes to the emergence of such reasoning capability, we propose that we can view an LM as deriving new conclusions by aggregating indirect reasoning paths seen at pre-training time. We found this perspective effective in two important cases of reasoning: logic reasoning with knowledge graphs (KGs) and chain-of-thought (CoT) reasoning. More specifically, we formalize the reasoning paths as random walk paths on the knowledge/reasoning graphs. Analyses of learned LM distributions suggest that a weighted sum of relevant random walk path probabilities is a reasonable way to explain how LMs reason. Experiments and analysis on multiple KG and CoT datasets reveal the effect of training on random walk paths and suggest that augmenting unlabeled random walk reasoning paths can improve real-world multi-step reasoning performance. code: https://github.com/WANGXinyiLinda/LM_random_walk
Pause and Reflect: Conformal Aggregation for Chain-of-Thought Reasoning
Department of Mathematics and Statistics(数学与统计学系);McGill University(麦吉尔大学);Department of Mathematics and Industrial Engineering(数学与工业工程系);Polytechnique de Montréal(蒙特利尔理工学院)
Aggregation of Reasoning: A Hierarchical Framework for Enhancing Answer Selection in Large Language Models
School of Computer Science, Fudan University(复旦大学计算机科学技术学院);National University of Singapore(新加坡国立大学);Shanghai AI Laboratory(上海人工智能实验室);Midea AI Research Center(美的AI研究中心)
Probabilistic Aggregation and Targeted Embedding Optimization for Collective Moral Reasoning in Large Language Models
School of Computation, Information and Technology, Technical University of Munich(计算、信息与技术学院,慕尼黑技术大学);School of Social Sciences and Technology, Technical University of Munich(社会科学与技术学院,慕尼黑技术大学)
KARPA: A Training-free Method of Adapting Knowledge Graph as References for Large Language Model's Reasoning Path Aggregation
Beijing University of Posts and Telecommunications(北京邮电大学);Tongji University(同济大学);Multimodal Art Projection Research Community(多模态艺术投影研究社区);Duke University(杜克大学);ZTE Corporation(中兴通讯股份有限公司)
Understanding the Language Model to Solve the Symbolic Multi-Step Reasoning Problem from the Perspective of Buffer Mechanism
Institute of Natural Sciences, MOE-LSC, Shanghai Jiao Tong University(上海交通大学自然科学院);School of Mathematical Sciences, Shanghai Jiao Tong University(上海交通大学数学学院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Huawei Noah’s Ark Lab(华为诺亚实验室);Key Laboratory of Marine Intelligent Equipment and System, Ministry of Education(教育部海洋智能装备与系统重点实验室)
A Decomposition Perspective to Long-context Reasoning for LLMs
Large Language Model Department, Tencent(腾讯大语言模型部门);Xi'an Jiaotong University(西安交通大学);Tencent(腾讯);Fudan University(复旦大学);City University of Hong Kong(香港城市大学)
Token-Level Policy Optimization: Linking Group-Level Rewards to Token-Level Aggregation via Sequence-Level Likelihood
College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of MOE, Jilin University(教育部符号计算与知识工程重点实验室,吉林大学);Baidu Inc.(百度公司);Tsinghua University(清华大学);State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院人工智能安全重点实验室,计算技术研究所)
Soft-Prompting with Graph-of-Thought for Multi-modal Representation Learning
School of Computer Science, Wuhan University(武汉大学计算机学院);National Engineering Research Center for Multimedia Software(国家多媒体软件工程技术研究中心);School of Electronic Information Engineering, Henan Polytechnic Institute(河南工业职业技术学院电子信息工程学院);JD Explore Academy(京东探索研究院)
Knowledge Graph Reasoning with Logics and Embeddings: Survey and Perspective
Zhejiang University(浙江大学);University of Oxford(牛津大学);The University of Edinburgh(爱丁堡大学);Alibaba-Zhejiang University Joint Research Institute of Frontier Technologies(阿里巴巴-浙江大学前沿技术联合研究院);Hangzhou Innovation Center, Zhejiang University(浙江大学杭州国际科创中心)
Hán Dān Xué Bù (Mimicry) or Qīng Chū Yú Lán (Mastery)? A Cognitive Perspective on Reasoning Distillation in Large Language Models
School of Philosophy, Anhui University(安徽大学哲学学院);Institute of Neuroscience, Chinese Academy of Sciences(中国科学院神经科学研究所);Faculty of Education, University of Cambridge(剑桥大学教育学院);School of Foreign Studies, South China Normal University(华南师范大学外语学院);Division of Psychology and Language Sciences, University College London(伦敦大学学院心理学与语言科学系)
Token-Level Policy Optimization: Linking Group-Level Rewards to Token-Level Aggregation via Markov Likelihood
Baidu Inc(百度公司);College of Computer Science and Technology, Jilin University(吉林大学计算机科学与技术学院);Key Laboratory of Symbolic Computation and Knowledge Engineering of MOE, Jilin University(吉林大学教育部符号计算与知识工程重点实验室);State Key Laboratory of AI Safety, Institute of Computing Technology, Chinese Academy of Sciences(中国科学院人工智能安全国家重点实验室)
Wrong-of-Thought: An Integrated Reasoning Framework with Multi-Perspective Verification and Wrong Information
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Research Center for SCIR, Harbin Institute of Technology(哈尔滨工业大学SCIR研究中心);Qilu University of Technology (Shandong Academy of Sciences)(齐鲁工业大学(山东省科学院));Yunnan University(云南大学)