Hit-RAG: Learning to Reason with Long Contexts via Preference Alignment
Tongji University(同济大学);The City University of New York(纽约城市大学);University of Technology Sydney(悉尼大学);Huazhong University of Science and Technology(华中科技大学);Shenzhen University of Advanced Technology(深圳先进技术大学)
Despite the promise of Retrieval-Augmented Generation in grounding Multimodal Large Language Models with external knowledge, the transition to extensive contexts often leads to significant attention dilution and reasoning hallucinations. The surge in information density causes critical evidence to be submerged by voluminous noise, which complicates the discernment of relevant fragments within a dense input. In this paper, we propose \textbf{Hit-RAG}, a multi-stage preference alignment framework designed to resolve these cognitive bottlenecks through a progressive optimization pipeline. Our approach systematically refines the utilization of external evidence via three distinct stages. First, Supervised Fine-tuning establishes baseline context awareness to minimize information neglect. Next, Discriminative Preference Alignment enhances robustness against misleading distractors. Finally, Group-Relative Policy Optimization stabilizes logical synthesis to prevent reasoning collapse. Extensive evaluations on eight benchmarks demonstrate that Hit-RAG consistently yields substantial performance gains, enabling models to bridge the gap between context acquisition and accurate reasoning while surpassing much larger counterparts in long-context scenarios.
Towards Agentic RAG with Deep Reasoning: A Survey of RAG-Reasoning Systems in LLMs
Tsinghua University(清华大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);The University of Tokyo(东京大学);Peking University(北京大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);HKUST(香港科技大学)
CARE-RAG - Clinical Assessment and Reasoning in RAG
Department of Computer Science(计算机科学系);University of Texas at Austin(德克萨斯大学奥斯汀分校);Behavioral Science and Psychiatry(行为科学与精神病学);Department of Statistics(统计学系);University of Michigan(密歇根大学);School of Information(信息学院)
RAG-Star: Enhancing Deliberative Reasoning with Retrieval Augmented Verification and Refinement
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Wuhan University of Science and Technology(武汉科技大学);National University of Singapore(新加坡国立大学);Northeastern University at Qinhuangdao(东北大学秦皇岛分校);BOSS Zhipin(BOSS直聘)
Eliciting Critical Reasoning in Retrieval-Augmented Language Models via Contrastive Explanations
Idiap Research Institute(Idiap研究机构);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);National Biomarker Centre (NBC), CRUK Manchester Institute(国家生物标志物中心(NBC),CRUK曼彻斯特研究所)
CoT-RAG: Integrating Chain of Thought and Retrieval-Augmented Generation to Enhance Reasoning in Large Language Models
School of Computer Science and Technology, Huazhong University of Science and Technology, Wuhan, China(华中科技大学计算机科学与技术学院);Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology, Wuhan, China(华中科技大学光电实验室);Department of Computer Science, Bowling Green State University, Ohio, USA(Bowling Green State University 计算机科学系);Department of Computer Science, Aalborg University, Aalborg, Denmark(Aalborg University 计算机科学系);Huawei Technologies Co., Ltd, Shenzhen, China(华为技术有限公司)
RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integration
Retrieval is Not Enough: Enhancing RAG Reasoning through Test-Time Critique and Optimization
Zhejiang University(浙江大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);South China University of Technology(华南理工大学);University of British Columbia(不列颠哥伦比亚大学);Fudan University(复旦大学);University of Hong Kong(香港大学)
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University(武汉大学电子信息学院);School of Computing, Dublin City University(都柏林城市大学计算机学院);School of Public Health, Wuhan University(武汉大学公共卫生学院);Insight Centre for Data Analytics, University of Galway(Galway大学数据分析研究中心);Insight Centre for Data Analytics, Dublin City University(都柏林城市大学数据分析研究中心)
PonsRAG: A Pons-Inspired RAG Bridging Cognitive Islands for Coordinated Long Narrative Reasoning
School of Future Technology, South China University of Technology(华南理工大学未来技术学院);TikTok Inc(字节跳动公司);School of Artificial Intelligence, Sun Yat-sen University(中山大学人工智能学院);School of Software Engineering, Sun Yat-sen University(中山大学软件工程学院)
UR$^2$: Unify RAG and Reasoning through Reinforcement Learning
Dept. of Comp. Sci. & Tech., Institute for AI, Tsinghua University, Beijing, China(计算机科学与技术系,人工智能研究院,清华大学,北京,中国);Institute for AI Industry Research (AIR), Tsinghua University, Beijing, China(人工智能产业研究机构(AIR),清华大学,北京,中国);School of Management Science & Information Engineering, Hebei University of Economics and Business, Hebei, China(管理科学与信息工程学院,河北经贸大学,河北,中国)
RAGAR, Your Falsehood Radar: RAG-Augmented Reasoning for Political Fact-Checking using Multimodal Large Language Models
Institute for Natural Language Processing, University of Stuttgart(斯图加特大学自然语言处理研究所);appliedAI Institute for Europe gGmbH(欧洲appliedAI研究所(非营利有限责任公司));appliedAI Initiative GmbH(appliedAI倡议有限责任公司)
Agentic AI with Orchestrator-Agent Trust: A Modular Visual Classification Framework with Trust-Aware Orchestration and RAG-Based Reasoning
University of the Peloponnese, Department of Informatics and Telecommunications(希腊皮埃蒙特大学信息与电信系);Cornell University, Department of Biological and Environmental Engineering(康奈尔大学生物与环境工程系)
Open-RAG: Enhanced Retrieval-Augmented Reasoning with Open-Source Large Language Models
Bangladesh University of Engineering and Technology(孟加拉工程技术大学);Cohere For AI(Cohere AI研究团队);University of North Texas(北得克萨斯大学);York University(约克大学);Salesforce Research(Salesforce研究院);Qatar Computing Research Institute (QCRI)(卡塔尔计算研究所)
Generating Leakage-Free Benchmarks for Robust RAG Evaluation
Department of Computer Science, Purdue University(普渡大学计算机科学系);New Jersey Institute of Technology(新泽西理工学院);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft Research(微软研究院)
IA-RAG: Interval-Algebra-Driven Temporal Reasoning for Dynamic Knowledge Retrieval
East China Normal University(华东师范大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);University of Shanghai for Science and Technology(上海科技大学);Harbin Engineering University(哈尔滨工程大学)
Mathematical Reasoning for Unmanned Aerial Vehicles: A RAG-Based Approach for Complex Arithmetic Reasoning
Department of Computer Science(计算机科学系);Institute For Artificial Intelligence(人工智能研究所);Hamm-Lippstadt University of Applied Sciences(哈姆-利普施塔特应用科学大学);University of Stuttgart(斯图加特大学)
Privacy-Preserving Reasoning with Knowledge-Distilled Parametric Retrieval Augmented Generation
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(北京未来区块链与隐私计算先进创新中心);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);School of Computer Science and Engineering, Beihang University(北京航空航天大学计算机科学与工程学院);Meituan(美团)