Prompting schemes such as Chain of Thought, Tree of Thoughts, and Graph of Thoughts can significantly enhance the reasoning capabilities of large language models. However, most existing schemes require users to define static, problem-specific reasoning structures that lack adaptability to dynamic or unseen problem types. Additionally, these schemes are often under-optimized in terms of hyperparameters, prompts, runtime, and prompting cost. To address these limitations, we introduce Framework of Thoughts (FoT)--a general-purpose foundation framework for building and optimizing dynamic reasoning schemes. FoT comes with built-in features for hyperparameter tuning, prompt optimization, parallel execution, and intelligent caching, unlocking the latent performance potential of reasoning schemes. We demonstrate FoT's capabilities by implementing three popular schemes--Tree of Thoughts, Graph of Thoughts, and ProbTree--within FoT. We empirically show that FoT enables significantly faster execution, reduces costs, and achieves better task scores through optimization. We release our codebase to facilitate the development of future dynamic and efficient reasoning schemes.
GG-Nav: Goal-oriented Grounding Chain-of-Thought Elicits Reasoning in Navigation Foundation Models
Zhejiang University(浙江大学);Shanghai AI Laboratory(上海人工智能实验室);University of Science and Technology of China(中国科学技术大学);Tongji University(同济大学);The University of Hong Kong(香港大学)
Integrating Chain-of-Thought and Retrieval Augmented Generation Enhances Rare Disease Diagnosis from Clinical Notes
Raymond G. Perelman Center for Cellular and Molecular Therapeutics, Children's Hospital of Philadelphia(费城儿童医院雷蒙德·G·佩雷尔曼细胞与分子治疗中心);University of Pennsylvania(宾夕法尼亚大学);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)
VisDoT : Enhancing Visual Reasoning through Human-Like Interpretation Grounding and Decomposition of Thought
Department of Computer Science and Artificial Intelligence, Dongguk University(东国大学计算机科学与人工智能系);Department of Electronics and Electrical Engineering, Dongguk University(东国大学电子与电气工程系)
Ladder-of-Thought: Using Knowledge as Steps to Elevate Stance Detection
Centre for Frontier AI Research (CFAR), A*STAR(新加坡科技研究局前沿人工智能研究中心(CFAR));Institute of High Performance Computing (IHPC), A*STAR(新加坡科技研究局高性能计算研究所(IHPC));DSO National Laboratories(DSO国家实验室)
LLMs can Find Mathematical Reasoning Mistakes by Pedagogical Chain-of-Thought
Shanghai Business School(上海商学院);Learnable.AI Inc.(Learnable.AI公司);Centre for Frontier AI Research, A*STAR(前沿人工智能研究中心,A*STAR);Institute of High-Performance Computing, A*STAR(高性能计算研究所,A*STAR);The Hong Kong Polytechnic University(香港理工大学);Microsoft Research Asia(微软亚洲研究院)
M$^3$CoT: A Novel Benchmark for Multi-Domain Multi-step Multi-modal Chain-of-Thought
Research Center for Social Computing and Information Retrieval(社会计算与信息检索研究中心);Harbin Institute of Technology(哈尔滨工业大学);School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Shanghai AI Laboratory(上海人工智能实验室)
COTCAgent: Preventive Consultation via Probabilistic Chain-of-Thought Completion
School of Computing and Data Science, The University of Hong Kong(香港大学计算与数据科学学院);Shenzhen Institute for Advanced Study, University of Electronic Science and Technology of China(中国电子科学与技术大学深圳高级研究所);School of Computer Science, The University of Sydney(悉尼大学计算机科学学院)
Expanding Reasoning Potential in Foundation Model by Learning Diverse Chains of Thought Patterns
School of Computer Science, Peking University(北京大学计算机科学系);Meituan(美团);State Key Laboratory of Multimedia Information Processing, Peking University(北京大学多媒体信息处理国家重点实验室)
Advancing Financial Risk Prediction Through Optimized LSTM Model Performance and Comparative Analysis
Columbia University(哥伦比亚大学);Rutgers University(罗格斯大学);University of Connecticut Business School(康涅狄格大学商学院);Stevens Institute of Technological(史蒂文斯理工学院)
CoT-X: An Adaptive Framework for Cross-Model Chain-of-Thought Transfer and Optimization
Purdue University(普渡大学);Baruch College, City University of New York(纽约市立大学巴鲁克学院);The Ohio State University(俄亥俄州立大学);AI Agent Lab(AI Agent实验室);Appcubic;Emory University(埃默里大学)
Neural Foundations of Mental Simulation: Future Prediction of Latent Representations on Dynamic Scenes
McGovern Institute for Brain Research, MIT(麻省理工学院麦戈文脑研究所);Reality Labs, Meta(Meta现实实验室);Department of Brain and Cognitive Sciences, MIT(麻省理工学院脑与认知科学系);Department of Electrical Engineering and Computer Science, MIT(麻省理工学院电气工程与计算机科学系)
AgenticRAG: Tool-Augmented Foundation Models for Zero-Shot Explainable Recommender Systems
Department of Software \& Microelectronics Peking University Beijing, China;Department of Software \& Microelectronics Peking University Beijing, China hangli\;Department of Software \& Microelectronics Peking University Beijing, China zehua\;Department of Software \& Microelectronics Peking University Beijing, China xiaofan\;Economic Law School China University of Political Science;School of Computer Science Peking University Beijing, China
Scaling Graph Chain-of-Thought Reasoning: A Multi-Agent Framework with Efficient LLM Serving
Nanjing University(南京大学);Ant Group(蚂蚁集团);University of New South Wales(新南威尔士大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Tsinghua University(清华大学)
Medical Hallucinations in Foundation Models and Their Impact on Healthcare
Massachusetts Institute of Technology(麻省理工学院);Harvard Medical School(哈佛医学院);University of Washington(华盛顿大学);Carnegie Mellon University(卡内基梅隆大学);Seoul National University Hospital(首尔国立大学医院);Google Research(谷歌研究);Google DeepMind(谷歌DeepMind);Columbia University(哥伦比亚大学);Johns Hopkins University(约翰霍普金斯大学)