Retrieval-augmented generation (RAG) has proven to be effective in mitigating hallucinations in large language models, yet its effectiveness remains limited in complex, multi-step reasoning scenarios. Recent efforts have incorporated search-based interactions into RAG, enabling iterative reasoning with real-time retrieval. Most approaches rely on outcome-based supervision, offering no explicit guidance for intermediate steps. This often leads to reward hacking and degraded response quality. We propose Bi-RAR, a novel retrieval-augmented reasoning framework that evaluates each intermediate step jointly in both forward and backward directions. To assess the information completeness of each step, we introduce a bidirectional information distance grounded in Kolmogorov complexity, approximated via language model generation probabilities. This quantification measures both how far the current reasoning is from the answer and how well it addresses the question. To optimize reasoning under these bidirectional signals, we adopt a multi-objective reinforcement learning framework with a cascading reward structure that emphasizes early trajectory alignment. Empirical results on seven question answering benchmarks demonstrate that Bi-RAR surpasses previous methods and enables efficient interaction and reasoning with the search engine during training and inference.
Personalizing Student-Agent Interactions Using Log-Contextualized Retrieval-Augmented Generation (RAG)
1Department of Computer Science, Vanderbilt University, Nashville, USA 2College of Engineering \& Science, University of Detroit Mercy, Detroit, USA 3The School for Science;Math, Vanderbilt University, Nashville, USA
DeepRAG: Thinking to Retrieve Step by Step for Large Language Models
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所信息处理实验室);University of Chinese Academy of Sciences(中国科学院大学);Pattern Recognition Center, WeChat AI, Tencent Inc, China(腾讯人工智能部模式识别中心)
Awakening Augmented Generation: Learning to Awaken Internal Knowledge of Large Language Models for Question Answering
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Unisound(云知声)
FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation
School of Informatics, Xiamen University(厦门大学信息学院);Institute of Artificial Intelligence, Xiamen University(厦门大学人工智能研究院);The Hong Kong Polytechnic University(香港理工大学);Migu Meland Co., Ltd(Migu Meland公司);Soochow University(苏州大学);Singapore Management University(新加坡管理大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Fast, Slow, and Tool-augmented Thinking for LLMs: A Review
School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China(上海交通大学机械工程学院);School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China(上海交通大学计算机科学学院);Huawei Technologies Co., Ltd., Beijing 100084, China(华为技术有限公司);Department of Systems Engineering and Engineering Management, The Chinese University of Hong Kong, Hong Kong 999077, China(香港中文大学系统工程与工程管理系);Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong 999077, China(香港中文大学计算机科学与工程系);Huawei Hong Kong Research Center, Hong Kong 999077, China(华为香港研究中心)
MoM: Mixtures of Scenario-Aware Document Memories for Retrieval-Augmented Generation Systems
School of Information, Renmin University of China, Beijing, China(中国人民大学信息学院);MemTensor (Shanghai) Technology Co., Ltd.(MemTensor(上海)技术有限公司);Institute for Advanced Algorithms Research, Shanghai(上海先进算法研究所)
The Price of a Second Thought: On the Evaluation of Reasoning Efficiency in Large Language Models
University of Electronic Science and Technology of China(电子科技大学);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Nanyang Technological University(南洋理工大学)
Construction contract risk identification based on knowledge-augmented language model
College of Civil Engineering and Architecture, Zhejiang University(浙江大学建筑工程学院);PowerChina Huadong Engineering Corporation Limited(中国电力工程顾问集团华东电力设计院有限公司)
Teaching Thinking Models to Reason with Tools: A Full-Pipeline Recipe for Tool-Integrated Reasoning
Zhejiang University(浙江大学);Shanghai AI Laboratory(上海人工智能实验室);Peking University(北京大学);The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学)
Atomic Thinking of LLMs: Decoupling and Exploring Mathematical Reasoning Abilities
Sun Yat-sen University(中山大学);Tsinghua University(清华大学);ByteDance Inc(字节跳动公司);Arizona State University(亚利桑那州立大学);Tencent Youtu Lab(腾讯优图实验室);Fudan University(复旦大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Guangdong Provincial Key Laboratory of Fire Science and Intelligent Emergency Technology(广东省消防科学与智能应急技术重点实验室);University of Illinois Chicago(伊利诺伊大学香槟分校)
Shanghai AI Laboratory(上海人工智能实验室);Harbin Institute of Technology(哈尔滨工业大学);Fudan University(复旦大学);CUHK(香港中文大学);Tsinghua University(清华大学);CUHK-Shenzhen(香港中文大学深圳校区);UESTC(电子科技大学);USTC(中国科学技术大学)
RATT: A Thought Structure for Coherent and Correct LLM Reasoning
Portland State University(波特兰州立大学);Renmin University of China(中国人民大学);Pennsylvania State University(宾夕法尼亚州立大学);Dalian Maritime University(大连海事大学);University of Kansas(堪萨斯大学)