Scaling Graph Chain-of-Thought Reasoning: A Multi-Agent Framework with Efficient LLM Serving
Nanjing University(南京大学);Ant Group(蚂蚁集团);University of New South Wales(新南威尔士大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Tsinghua University(清华大学)
Graph Chain-of-Thought (Graph-CoT) enables large language models (LLMs) to perform step-by-step reasoning over graph-structured knowledge, but existing pipelines suffer from low accuracy, excessive token usage, high latency, and low throughput due to single-agent monolithic prompts, repeated context re-encoding, and inefficient serving execution. We present GLM, the first multi-agent Graph-CoT system co-designed with an optimized LLM serving architecture. GLM decomposes reasoning into specialized agents for classification, reasoning, action generation, and graph retrieval, enabling branching and selective context sharing to reduce prompt length and reasoning iterations while preserving reasoning quality, thereby improving accuracy and reducing overall token consumption. To scale inference, we introduce a Graph-CoT-aware LLM inference mechanism with graph-specific KV-cache management, priority-based eviction, and pipelined execution to improve serving efficiency. Experiments demonstrate that GLM improves answer accuracy by up to 38%, reduces token cost by up to 95.7%, lowers inference latency by 90.3%, and achieves up to 15.1x higher throughput compared to state-of-the-art Graph-CoT baselines, enabling efficient adoption for complex real-world reasoning at scale.
Reasoning Language Model Inference Serving Unveiled: An Empirical Study
The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);HKBU(香港 Baptist University);University of Wisconsin-Madison(威斯康星大学麦迪逊分校);Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));The Hong Kong University of Science and Technology(香港科学与技术大学)
Retrieval-of-Thought: Efficient Reasoning via Reusing Thoughts
Department of Computer Science and Engineering, University of Minnesota(明尼苏达大学计算机科学与工程系);Department of Computer Science and Engineering, University of California Santa Cruz(加州大学圣克鲁兹分校计算机科学与工程系);Argonne National Laboratory(阿贡国家实验室)
Training Multimodal Large Reasoning Models Needs Better Thoughts: A Three-Stage Framework for Long Chain-of-Thought Synthesis and Selection
School of Computer Science and Engineering(计算机科学与工程学院);Key Laboratory of Computer Network and Information Integration (SEU), Ministry of Education(计算机网络与信息集成重点实验室(SEU))
Think Consistently, Reason Efficiently: Energy-Based Calibration for Implicit Chain-of-Thought
University of Oxford(牛津大学);Tsinghua University(清华大学);Tencent(腾讯);Southern University of Science and Technology(南方科技大学);National University of Singapore(新加坡国立大学)
Thought Purity: A Defense Framework For Chain-of-Thought Attack
Huzhou University(湖州大学);Zhejiang Key Laboratory of Intelligent Education Technology and Application(浙江智能教育技术与应用重点实验室);University of Science and Technology of China(中国科学技术大学);Alibaba Group(阿里巴巴集团);Zhejiang University of Technology(浙江工业大学)
Understanding Reasoning in Chain-of-Thought from the Hopfieldian View
King Abdullah University of Science and Technology(阿卜杜拉国王科技大学);Soochow University(苏州大学);University of Southampton(南安普顿大学);Arizona State University(亚利桑那州立大学)
Landscape of Thoughts: Visualizing the Reasoning Process of Large Language Models
TMLR Group, Hong Kong Baptist University(香港 Baptist 大学 TMLR 团体);Stanford University(斯坦福大学);Mila - Québec AI Institute(魁北克 AI 院);Université de Montréal(蒙特利尔大学);HEC Montréal(蒙特利尔 HEC 学院);Intel AI Lab(英特尔 AI 实验室)
Spectral-Progressive Thought Flow for Lightweight Multimodal Reasoning
Informatics Institute, University of Amsterdam, Amsterdam, The Netherlands(阿姆斯特丹大学信息学院);Department of Computer Science, University College London(伦敦大学学院计算机科学系);University of Thessaly, Volos, Greece(塞萨洛尼基大学);Department of Electronic and Electrical Engineering, Trinity College Dublin, Dublin, Ireland(都柏林信任学院电子与电气工程系);School of Information Technology, Halmstad University, Halmstad, Sweden(哈姆斯塔德大学信息科技学院);Amazon AGI, Seattle, USA(亚马逊人工智能研究部)