Large language models (LLMs), while exhibiting exceptional performance, suffer from hallucinations, especially on knowledge-intensive tasks. Existing works propose to augment LLMs with individual text units retrieved from external knowledge corpora to alleviate the issue. However, in many domains, texts are interconnected (e.g., academic papers in a bibliographic graph are linked by citations and co-authorships) which form a (text-attributed) graph. The knowledge in such graphs is encoded not only in single texts/nodes but also in their associated connections. To facilitate the research of augmenting LLMs with graphs, we manually construct a Graph Reasoning Benchmark dataset called GRBench, containing 1,740 questions that can be answered with the knowledge from 10 domain graphs. Then, we propose a simple and effective framework called Graph Chain-of-thought (Graph-CoT) to augment LLMs with graphs by encouraging LLMs to reason on the graph iteratively. Each Graph-CoT iteration consists of three sub-steps: LLM reasoning, LLM-graph interaction, and graph execution. We conduct systematic experiments with three LLM backbones on GRBench, where Graph-CoT outperforms the baselines consistently. The code is available at https://github.com/PeterGriffinJin/Graph-CoT.
DetermLR: Augmenting LLM-based Logical Reasoning from Indeterminacy to Determinacy
XiaoMi AI Lab(小米AI实验室);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);University of Electronic Science and Technology of China(电子科技大学)
TAP4LLM: Table Provider on Sampling, Augmenting, and Packing Semi-structured Data for Large Language Model Reasoning
National University of Singapore(新加坡国立大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Microsoft(微软);Xi’an Jiaotong University(西安交通大学);Ant Research(蚂蚁研究院)
Think Consistently, Reason Efficiently: Energy-Based Calibration for Implicit Chain-of-Thought
University of Oxford(牛津大学);Tsinghua University(清华大学);Tencent(腾讯);Southern University of Science and Technology(南方科技大学);National University of Singapore(新加坡国立大学)
Thought Graph: Generating Thought Process for Biological Reasoning
University of Texas at Austin(德克萨斯大学奥斯汀分校);Arizona State University(亚利桑那州立大学);University of Pennsylvania(宾夕法尼亚大学);University of California San Diego(加利福尼亚大学圣迭戈分校);The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);California Institute of Technology(加利福尼亚理工学院)
Understanding Reasoning in Chain-of-Thought from the Hopfieldian View
King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Soochow University(苏州大学);University of Southampton(南安普顿大学);Arizona State University(亚利桑那州立大学)
Towards Better Understanding of Program-of-Thought Reasoning in Cross-Lingual and Multilingual Environments
School of Information Science and Technology, VISTEC(信息科学与技术学院,VISTEC);KAIST(韩国科学技术院);Cohere;SCB 10X;AI Singapore(AI新加坡);Department of Computer Engineering, Chulalongkorn University(朱拉隆梭大学计算机工程系)
Blind Spot Navigation in Large Language Model Reasoning with Thought Space Explorer
Clemson University(克莱姆森大学);Université de Montréal(蒙特利尔大学);Center for Advanced AI, Accenture(Accenture高级人工智能中心);The University of Alabama(阿拉巴马大学);University of Kansas(堪萨斯大学);Arizona State University(亚利桑那州立大学)
Render-of-Thought: Rendering Textual Chain-of-Thought as Images for Visual Latent Reasoning
Tencent BAC(腾讯BAC);Shenzhen International Graduate School, Tsinghua University(深圳国际研究生院,清华大学);School of Electronic and Computer Engineering, Peking University(北京大学电子与计算机工程学院);School of Mathematics and Statistics, University of Glasgow(格拉斯哥大学数学与统计学学院)
ThoughtSource: A central hub for large language model reasoning data
Medical University of Vienna(维也纳医科大学);Technical University of Denmark(丹麦技术大学);Copenhagen University Hospital(哥本哈根大学医院);The Royal Institute of Technology (KTH)(皇家理工学院(KTH))
Not All Thoughts are Generated Equal: Efficient LLM Reasoning via Multi-Turn Reinforcement Learning
AI Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)人工智能方向);Didichuxing Co. Ltd(滴滴出行有限公司);CSE, The Hong Kong University of Science and Technology(香港科学与技术大学计算机科学与工程系)
A*-Thought: Efficient Reasoning via Bidirectional Compression for Low-Resource Settings
Beijing University of Posts and Telecommunications(北京邮电大学);Dept. of Comp. Sci. & Tech., Tsinghua University(清华大学计算机科学与技术系);Northeastern University(东北大学);Institute for AI, Tsinghua University(清华大学人工智能研究院);Beijing National Research Center for Information Science and Technology(北京信息科学研究中心)