In this paper, we introduce Concise Chain-of-Thought (CCoT) prompting. We compared standard CoT and CCoT prompts to see how conciseness impacts response length and correct-answer accuracy. We evaluated this using GPT-3.5 and GPT-4 with a multiple-choice question-and-answer (MCQA) benchmark. CCoT reduced average response length by 48.70% for both GPT-3.5 and GPT-4 while having a negligible impact on problem-solving performance. However, on math problems, GPT-3.5 with CCoT incurs a performance penalty of 27.69%. Overall, CCoT leads to an average per-token cost reduction of 22.67%. All code, data, and supplemental materials are available on GitHub at https://github.com/matthewrenze/jhu-concise-cot
SEER: Self-Enhancing Chain-of-Thought Compression for Reasoning Models
The State Key Laboratory of Blockchain and Data Security, Zhejiang University(区块链与数据安全国家重点实验室,浙江大学);State Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学)
Visual Thoughts: A Unified Perspective of Understanding Multimodal Chain-of-Thought
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology(哈尔滨工业大学社会计算与交互机器人研究中心);Institute of Computing and Intelligence, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学深圳研究院计算与智能研究所);Text Computing and Cognitive Intelligence Ministry of Education Engineering Research Center, Guizhou University(贵州大学文字计算与认知智能教育部工程研究中心);Chinese University of Hong Kong(香港中文大学);Shanghai AI Laboratory(上海人工智能实验室);National University of Singapore(新加坡国立大学);Peking University(北京大学);ByteDance Seed (China)(字节跳动种子(中国))
Not All Thoughts are Generated Equal: Efficient LLM Reasoning via Multi-Turn Reinforcement Learning
AI Thrust, The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州)人工智能方向);Didichuxing Co. Ltd(滴滴出行有限公司);CSE, The Hong Kong University of Science and Technology(香港科学与技术大学计算机科学与工程系)
Focused Chain-of-Thought: Efficient LLM Reasoning via Structured Input Information
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Technical University of Darmstadt(德累斯顿技术大学);University of Kassel(卡塞尔大学);TU Dortmund University(Dortmund技术大学);TU Center for Trustworthy Data Science and Security, University Alliance Ruhr(TU可信数据科学与安全中心,鲁尔大学联盟);Hessian Center for AI (Hessian.AI)(黑森人工智能中心(黑森.AI));Centre for Cognitive Science, Technical University of Darmstadt(认知科学中心,德累斯顿技术大学)
Symbolic Chain-of-Thought Distillation: Small Models Can Also "Think" Step-by-Step
University of California Los Angeles(加利福尼亚大学洛杉矶分校);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);University of Southern California(南加利福尼亚大学);Yonsei University(延世大学);University of Washington(华盛顿大学)
An automatically discovered chain-of-thought prompt generalizes to novel models and datasets
Medical University of Vienna(维也纳医科大学);Johannes Kepler University Linz(林茨约翰内斯·开普勒大学);KTH Royal Institute of Technology(KTH皇家理工学院);Humboldt University Berlin(柏林洪堡大学)
Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors
Meta;Mila-Quebec AI Institute, University of Montreal(魁北克AI研究所,蒙特利尔大学);Princeton University(普林斯顿大学);Mila--Quebec AI Institute, Université de Montréal(魁北克AI研究所,蒙特利尔大学)
Direct Value Optimization: Improving Chain-of-Thought Reasoning in LLMs with Refined Values
Zhejiang University(浙江大学);School of Engineering, Westlake University(西湖大学工程学院);Institute of Advanced Technology, Westlake Institute for Advanced Study(西湖高等研究院先进技术研究所);University College London(伦敦大学学院)
CoMT: A Novel Benchmark for Chain of Multi-modal Thought on Large Vision-Language Models
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);Key Laboratory of Data Intelligence and Advanced Computing in Provincial Universities, Soochow University(苏州大学省级高校数据智能与先进计算重点实验室);Research Center for SCIR, Harbin Institute of Technology(哈尔滨工业大学SCIR研究中心);National University of Singapore(新加坡国立大学)
When Compression Helps and When It Hurts: Condition-Aware Analysis of Chain-of-Thought Distillation
Ningbo Institute of Digital Twin, Eastern Institute of Technology, Ningbo(宁波数字孪生研究院,东方理工高等研究院,宁波);Viterbi School of Engineering, University of Southern California(南加州大学维特比工程学院);The Hong Kong Polytechnic University(香港理工大学);LMU Munich(慕尼黑大学);Saarland University(萨尔大学)
School of Computer Science, Beijing University of Posts and Telecommunications(北京邮电大学计算机学院);Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心);Kuaishou Technology(快手科技);Shanghai Jiao Tong University(上海交通大学)