Solving Quantitative Reasoning Problems with Language Models
Google Research(谷歌研究院)
Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhua… 展开作者
Aitor Lewkowycz, Anders Andreassen, David Dohan, Ethan Dyer, Henryk Michalewski, Vinay Ramasesh, Ambrose Slone, Cem Anil, Imanol Schlag, Theo Gutman-Solo, Yuhuai Wu, Behnam Neyshabur, Guy Gur-Ari, Vedant Misra
Language models have achieved remarkable performance on a wide range of tasks that require natural language understanding. Nevertheless, state-of-the-art models have generally struggled with tasks that require quantitative reasoning, such as solving mathematics, science, and engineering problems at the college level. To help close this gap, we introduce Minerva, a large language model pretrained on general natural language data and further trained on technical content. The model achieves state-of-the-art performance on technical benchmarks without the use of external tools. We also evaluate our model on over two hundred undergraduate-level problems in physics, biology, chemistry, economics, and other sciences that require quantitative reasoning, and find that the model can correctly answer nearly a third of them.
Puzzle Solving using Reasoning of Large Language Models: A Survey
Artificial Intelligence and Learning Systems Laboratory(人工智能与学习系统实验室);School of Electrical and Computer Engineering(电气与计算机工程学院);National Technical University of Athens(希腊雅典国家技术大学)
Limitations of Large Language Models in Clinical Problem-Solving Arising from Inflexible Reasoning
Department of Neurology and Neurologic Sciences(神经病学与神经科学系);Stanford University(斯坦福大学);Image Guided Therapy and Research Facility(影像引导治疗与研究设施);University of Dundee(邓迪大学);Weill Institute of Neurology and Neurosciences(韦尔神经病学与神经科学研究所);University of California, San Francisco(加州大学旧金山分校);Department of Systems and Enterprises(系统与企业系);Stevens Institute of Technology(史蒂文斯理工学院);Department of EECS(电子工程与计算机科学系);University of California Berkeley(加州大学伯克利分校)
GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving
Idiap Research Institute(Idiap研究 institute);X-Humanoid;Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);Cancer Biomarker Centre, CRUK Manchester Institute(癌症生物标志物中心,CRUK曼彻斯特研究所)
Intern-S1-MO: Long-horizon Reasoning Agent for Olympiad?Level Mathematical Problem Solving
Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);MMLab;The Chinese University of Hong Kong(香港中文大学);ICMAT Spanish National Research Council(西班牙国家科研 council);The High School Affiliated to Renmin University of China(中国人民大学附属高中);Ren Hui Academy of Beijing(北京润辉学院)
Demystifying Scientific Problem-Solving in LLMs by Probing Knowledge and Reasoning
Department of Computer Science, Yale University;Department of Molecular \& Cellular Biology, Harvard University;Allen Institute for AI;Department of Computer Science, Northwestern University
Teaching LLMs According to Their Aptitude: Adaptive Reasoning for Mathematical Problem Solving
The Hong Kong University of Science and Technology(香港科学与技术大学);Huawei Noah’s Ark Lab(华为诺亚实验室);Zhejiang University(浙江大学);Peking University(北京大学);The Hong Kong Polytechnic University(香港理工大学);University of Surrey(萨里大学)
XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoning
School of Computing and Information Systems, Singapore Management University(计算与信息系统学院,新加坡管理大学);Institute of Trustworthy Embodied AI, Fudan University(可信具身人工智能研究院,复旦大学)
Reasoning via Video: The First Evaluation of Video Models' Reasoning Abilities through Maze-Solving Tasks
DeepWisdom;Tsinghua University(清华大学);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Renmin University of China(中国人民大学);University of Oxford(牛津大学);National University of Singapore(新加坡国立大学);Xiamen University(厦门大学);Hong Kong University of Science and Technology (GuangZhou)(香港科技大学(广州))
Benchmarking Foundation Models with Retrieval-Augmented Generation in Olympic-Level Physics Problem Solving
AAII, University of Technology Sydney, New South Wales, Australia(AAII,悉尼大学,新南威尔士州,澳大利亚);Eindhoven University of Technology, Eindhoven, The Netherlands(埃因霍温理工大学,埃因霍温,荷兰);University of Liverpool, Liverpool, United Kingdom(利物浦大学,利物浦,英国);University of New South Wales, New South Wales, Australia(新南威尔士大学,新南威尔士州,澳大利亚)
Advances in LLM Reasoning Enable Flexibility in Clinical Problem-Solving
Weill Institute of Neurology and Neurosciences(威尔神经与神经科学研究所);Carle Illinois College of Medicine(卡乐伊利诺伊医学院);University of California, San Francisco(加州大学旧金山分校);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Stanford University(斯坦福大学);University of Dundee(邓迪大学);Stevens Institute of Technology(史蒂文斯理工学院);University of California Berkeley(加州大学伯克利分校)
Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models
Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Institute for AI Industry Research (AIR), Tsinghua University(清华大学人工智能产业研究院)
MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
BRAC University(布拉克大学);United International University(国际联合大学);Qatar Computing Research Institute(卡塔尔计算研究所);Center for Computational & Data Sciences, Independent University, Bangladesh(计算与数据科学中心,独立大学,孟加拉国);Amazon GenAI(亚马逊生成人工智能);University of Virginia(弗吉尼亚大学)