Solving math word problems requires deductive reasoning over the quantities in the text. Various recent research efforts mostly relied on sequence-to-sequence or sequence-to-tree models to generate mathematical expressions without explicitly performing relational reasoning between quantities in the given context. While empirically effective, such approaches typically do not provide explanations for the generated expressions. In this work, we view the task as a complex relation extraction problem, proposing a novel approach that presents explainable deductive reasoning steps to iteratively construct target expressions, where each step involves a primitive operation over two quantities defining their relation. Through extensive experiments on four benchmark datasets, we show that the proposed model significantly outperforms existing strong baselines. We further demonstrate that the deductive procedure not only presents more explainable steps but also enables us to make more accurate predictions on questions that require more complex reasoning.
An Investigation of Robustness of LLMs in Mathematical Reasoning: Benchmarking with Mathematically-Equivalent Transformation of Advanced Mathematical Problems
Department of Computer Science University of Illinois Urbana–Champaign（计算机科学系伊利诺伊大学厄巴纳-香槟分校）；Department of Computer Science Stanford University（计算机科学系斯坦福大学）
MuggleMath: Assessing the Impact of Query and Response Augmentation on Math Reasoning
Alibaba Group（阿里巴巴集团）；University of Science and Technology of China（中国科学技术大学）；Institute of Dataspace, Hefei Comprehensive National Science Center（合肥综合性国家科学中心天枢研究院）
The Missing Primitive: Diagnosing and Repairing Mathematical Reasoning in Large Language Models
Texas A&M University（德克萨斯A&M大学）；Harvard University（哈佛大学）；Vanderbilt University（范德堡大学）；Stanford University（斯坦福大学）；DARPA（美国国防高级研究计划局）；University of North Carolina at Chapel Hill（北卡罗来纳大学教堂山分校）
FOLIO: Natural Language Reasoning with First-Order Logic
Yale University（耶鲁大学）；Harvard University（哈佛大学）；NVIDIA（英伟达）；Iowa City West High School（爱荷华城西部高中）；University of Washington（华盛顿大学）；University of Hong Kong（香港大学）；Penn State University（宾夕法尼亚州立大学）；Salesforce Research（Salesforce研究院）；Meta AI
Is Your Model Really A Good Math Reasoner? Evaluating Mathematical Reasoning with Checklist
Xi’an Jiaotong-Liverpool University（西交利物浦大学）；University of Liverpool（利物浦大学）；University of Macau（澳门大学）；HKUST（香港科技大学）；Microsoft Research Asia（微软亚洲研究院）；Duke Kunshan University（昆山杜克大学）
Towards Spoken Mathematical Reasoning: Benchmarking Speech-based Models over Multi-faceted Math Problems
Institute for Infocomm Research (I 2 R), A*STAR, Singapore（信息与通信研究 institute（I2R），A*STAR，新加坡）；Centre for Frontier AI Research (CFAR), A*STAR, Singapore（前沿人工智能研究 centre（CFAR），A*STAR，新加坡）
MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
BRAC University（布拉克大学）；United International University（国际联合大学）；Qatar Computing Research Institute（卡塔尔计算研究所）；Center for Computational & Data Sciences, Independent University, Bangladesh（计算与数据科学中心，独立大学，孟加拉国）；Amazon GenAI（亚马逊生成人工智能）；University of Virginia（弗吉尼亚大学）
InternLM-Math: Open Math Large Language Models Toward Verifiable Reasoning
Shanghai AI Laboratory（上海人工智能实验室）；Fudan University（复旦大学）；University of Southern California（南加州大学）；Shanghai Jiaotong University（上海交通大学）；Tsinghua University（清华大学）
Multimodal Mathematical Reasoning with Diverse Solving Perspective
Tongji University（同济大学）；National University of Singapore（新加坡国立大学）；Institute of Data Science, National University of Singapore（新加坡国立大学数据科学研究所）；Tencent（腾讯）；Center for Future Media, University of Electronic Science and Technology of China（电子科技大学未来媒体中心）
Math-LLaVA: Bootstrapping Mathematical Reasoning for Multimodal Large Language Models
University of Electronic Science and Technology of China（电子科技大学）；Tongji University（同济大学）；National University of Singapore（新加坡国立大学）；Singapore University of Technology and Design（新加坡科技设计大学）
CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models
School of Computer Science and Technology, East China Normal University（华东师范大学计算机科学与技术学院）；East China Normal University（华东师范大学）；Lab of Artificial Intelligence for Education, East China Normal University（华东师范大学教育人工智能实验室）
GeoMathCode: Understanding Interleaved Math-Code Reasoning for Geometry Problem Solving
Idiap Research Institute（Idiap研究 institute）；X-Humanoid；Department of Computer Science, University of Manchester（曼彻斯特大学计算机科学系）；Cancer Biomarker Centre, CRUK Manchester Institute（癌症生物标志物中心，CRUK曼彻斯特研究所）
