Large Language Models (LLMs) have shown potential in reasoning over structured environments, e.g., knowledge graph and table. Such tasks typically require multi-hop reasoning, i.e., match natural language utterance with instances in the environment. Previous methods leverage LLMs to incrementally build a reasoning path, where the LLMs either invoke tools or pick up schemas by step-by-step interacting with the environment. We propose Reasoning-Path-Editing (Readi), a novel framework where LLMs can efficiently and faithfully reason over structured environments. In Readi, LLMs initially generate a reasoning path given a query, and edit the path only when necessary. We instantiate the path on structured environments and provide feedback to edit the path if anything goes wrong. Experimental results on three KGQA and two TableQA datasets show the effectiveness of Readi, significantly surpassing previous LLM-based methods (by 9.1% Hit@1 on WebQSP, 12.4% on MQA-3H and 9.5% on WTQ), comparable with state-of-the-art fine-tuned methods (67% on CWQ and 74.7% on WebQSP) and substantially boosting the vanilla LLMs (by 14.9% on CWQ). Our code will be available on https://aka.ms/readi.
Residualized Similarity for Faithfully Explainable Authorship Verification
Department of Computer Science(计算机科学系);Department of Linguistics(语言学系);Institute for Advanced Computational Science(先进计算科学研究院);Stony Brook University(石溪大学)
PRIME: Planning and Retrieval-Integrated Memory for Enhanced Reasoning
Center for Healthcare Organization and Implementation Research, VA Bedford Health Care(VA Bedford Health Care 医疗组织与实施研究中心);Manning College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院);Miner School of Computer and Information Sciences, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校 Miner 信息与计算机科学学院)
R-Capsule: Compressing High-Level Plans for Efficient Large Language Model Reasoning
Tianjin University(天津大学);Tencent Hunyuan(腾讯文元);Peking University(北京大学);Fudan University(复旦大学);National Engineering Research Center of Educational Big Data and the Faculty of Artificial Intelligence in Education, Central China Normal University(教育大数据国家工程研究中心和教育人工智能学院,中央财经大学)
School of Computer Science and Technology, Beijing Institute of Technology, China(北京理工大学计算机科学与技术学院);School of Computer Science and Technology, Huazhong University of Science and Technology, China(华中科技大学计算机科学与技术学院);Independent, China(独立)
MolecularIQ: Characterizing Chemical Reasoning Capabilities Through Symbolic Verification on Molecular Graphs
ELLIS Unit Linz and LIT AI Lab, Institute for Machine Learning, Johannes Kepler University, Linz, Austria(林茨ELLIS单元和LIT人工智能实验室,机器学习研究所,约翰·凯撒大学,林茨,奥地利);Clinical Research Institute Medical Artificial Intelligence, Johannes Kepler University, Linz, Austria(医学人工智能临床研究研究所,约翰·凯撒大学,林茨,奥地利)
Detecting Unfaithful Chain-of-Thought via Circuit-Guided Internal-External Discrepancy
Jilin University(吉林大学);University of Central Florida(中央佛罗里达大学);Arizona State University(亚利桑那州立大学);University of Vienna(维也纳大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
Investigating CoT Monitorability in Large Reasoning Models
Provable Responsible AI and Data Analytics (PRADA) Lab(可证明负责任的人工智能与数据分析师实验室);King Abdullah University of Science and Technology(卡布斯大学);University of Georgia(佐治亚大学);University of Macau(澳门大学)
Interleaved Tool-Call Reasoning for Protein Function Understanding
School of Computer Science and Technology, Soochow University(苏州大学计算机科学与技术学院);Institute of Artificial Intelligence, Soochow University(苏州大学人工智能研究院);Changping Laboratory(昌平实验室);School of Software Engineering, USTC(中国科学技术大学软件学院)
ArgRAG: Explainable Retrieval Augmented Generation using Quantitative Bipolar Argumentation
University of Stuttgart(斯图加特大学);Bosch Center for AI(博世人工智能中心);Cardiff University(卡迪夫大学);University of Oxford(牛津大学);University of Cambridge(剑桥大学);Stanford University(斯坦福大学);University of Oslo(奥斯陆大学);University of Southampton(南安普顿大学)
Rethinking How to Remember: Beyond Atomic Facts in Lifelong LLM Agent Memory
TMLR Group, Hong Kong Baptist University(香港 Baptist 大学 TMLR 实验组);The University of Texas at Austin(德克萨斯大学奥斯汀分校);Shanghai Jiao Tong University(上海交通大学);Sydney AI Center, The University of Sydney(悉尼大学悉尼人工智能中心)
FaithCoT-Bench: Benchmarking Instance-Level Faithfulness of Chain-of-Thought Reasoning
Jilin University(吉林大学);University of Central Florida(中佛罗里达大学);Arizona State University(亚利桑那州立大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);City University of Hong Kong(香港城市大学)
RAIN-Merging: A Gradient-Free Method to Enhance Instruction Following in Large Reasoning Models with Preserved Thinking Format
Institute of Image Processing and Pattern Recoginition, School of Automation and Intelligent Sensing, Shanghai Jiao Tong University(图像处理与模式识别研究所,自动化与智能感知学院,上海交通大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));MoE Key Laboratory of System Control and Information Processing (Shanghai)(系统控制与信息处理国家重点实验室(上海))