We explore an evolutionary search strategy for scaling inference time compute in Large Language Models. The proposed approach, Mind Evolution, uses a language model to generate, recombine and refine candidate responses. The proposed approach avoids the need to formalize the underlying inference problem whenever a solution evaluator is available. Controlling for inference cost, we find that Mind Evolution significantly outperforms other inference strategies such as Best-of-N and Sequential Revision in natural language planning tasks. In the TravelPlanner and Natural Plan benchmarks, Mind Evolution solves more than 98% of the problem instances using Gemini 1.5 Pro without the use of a formal solver.
PTFA: An LLM-based Agent that Facilitates Online Consensus Building through Parallel Thinking
Nagoya Institute of Technology(名古屋技术大学);University of Southampton(南安普顿大学);University of Amsterdam(阿姆斯特丹大学);Japan Advanced Institute of Science and Technology(日本先进科学研究院)
Thinking Machines: Mathematical Reasoning in the Age of LLMs
Department of Informatics--- Science and Engineering (DISI), University of Bologna(信息科学与工程系(DISI),博洛尼亚大学);Department of Philosophy, University Paris 1 Panthéon-Sorbonne(哲学系,巴黎第一大学)
Individualized Cognitive Simulation in Large Language Models: Evaluating Different Cognitive Representation Methods
Department of Computer Science, University of Southern California(计算机科学系,南加州大学);College of Computing and Data Science, Nanyang Technological University(计算与数据科学学院,南洋理工大学);USC Institute for Creative Technologies(南加州大学创意技术研究所)
Harnessing the Reasoning Economy: A Survey of Efficient Reasoning for Large Language Models
The Chinese University of Hong Kong(香港中文大学);University of Macau(澳门大学);The University of Hong Kong(香港大学);Princeton University(普林斯顿大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
PRIME: Large Language Model Personalization with Cognitive Dual-Memory and Personalized Thought Process
Computer Science and Engineering, University of Michigan, Ann Arbor, MI(计算机科学与工程系,密歇根大学,安娜堡分校);Department of Political Science, Northeastern University, Boston, MA(政治学系,东北大学,波士顿分校)
该研究提出融合认知双记忆与个性化慢思考的 PRIME 框架,并构建基于 Reddit CMV 的长上下文个性化数据集,实验证明其可捕捉动态用户偏好。
PRefLexOR: Preference-based Recursive Language Modeling for Exploratory Optimization of Reasoning and Agentic Thinking
Center for Computational Science and Engineering(计算科学与工程中心);Schmarzman College of Computing(施马茨曼计算学院);Laboratory for Atomistic and Molecular Mechanics (LAMM)(原子与分子力学实验室);Massachusetts Institute of Technology(麻省理工学院)
Towards Self-Evolving Benchmarks: Synthesizing Agent Trajectories via Test-Time Exploration under Validate-by-Reproduce Paradigm
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Hong Kong University of Science and Technology(香港科技大学);University of Michigan(密歇根大学);Renmin University of China(中国人民大学);Shanghai Jiao Tong University(上海交通大学);Nanyang Technological University(南洋理工大学)