Large Language Models (LLMs) are increasingly used in math education not only as problem solvers but also as assessors of learners' reasoning. However, it remains unclear whether stronger math problem-solving ability is associated with stronger step-level assessment performance. This study examines that relationship using the GSM8K and MATH subsets of PROCESSBENCH, a human-annotated benchmark for identifying the earliest erroneous step in mathematical reasoning. We evaluate two LLM-based math tutor agent settings, instantiated with GPT-4 and GPT-5, in two independent tasks on the same math problems: solving the original problem and assessing a benchmark-provided solution by predicting the earliest erroneous step. Results show a consistent within-model pattern: assessment accuracy is substantially higher on math problem items the same model solved correctly than on items it solved incorrectly, with statistically significant associations across both models and datasets. At the same time, assessment remains more difficult than direct problem solving, especially on error-present solutions. These findings suggest that math problem-solving expertise supports stronger assessment performance, but reliable step-level diagnosis also requires additional capabilities such as step tracking, monitoring, and precise error localization. The results have implications for the design and evaluation of AI-supported Adaptive Instructional Systems (AISs) for formative assessment in math education.
SMART: Self-Generating and Self-Validating Multi-Dimensional Assessment for LLMs' Mathematical Problem Solving
School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院);Beijing Key Laboratory of Artificial Intelligence for Education Engineering Research Center of Intelligent Technology and Educational Application, Ministry of Education(北京市教育厅人工智能教育工程研究中心智能技术与教育应用联合实验室)
Leveraging Professional Radiologists' Expertise to Enhance LLMs' Evaluation for Radiology Reports
National Center for Biotechnology Information, National Library of Medicine, National Institutes of Health(美国国立卫生研究院国家医学图书馆国家生物技术信息中心);National Institutes of Health Clinical Center(美国国立卫生研究院临床中心)
Mathematical Computation and Reasoning Errors by Large Language Models
Institute for Intelligent Systems(智能系统研究所);University of Memphis(密苏里大学);AI4STEM Education Center(AI4STEM教育中心);University of Georgia(佐治亚大学);Educational Testing Service(教育测量服务)
SHIELD: LLM-Driven Schema Induction for Predictive Analytics in EV Battery Supply Chain Disruptions
Carnegie Mellon University(卡内基梅隆大学);Columbia University(哥伦比亚大学);Georgia Institute of Technology(佐治亚理工学院);University of Michigan(密歇根大学);Boston University(波士顿大学)
Unveiling the Landscape of Clinical Depression Assessment: From Behavioral Signatures to Psychiatric Reasoning
School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);CoAI Group, DCST, IAI, BNRIST, Tsinghua University(清华大学);University of International Relations(国际关系大学);Central China Normal University(华中师范大学);Lingxin AI(灵心AI);Yuquan Hospital, Tsinghua University(清华大学友谊医院)
The Hong Kong Polytechnic University(香港理工大学);Southern University of Science and Technology(南方科技大学);Tsinghua University(清华大学);Reallm Labs(Reallm实验室);Wuhan University(武汉大学);The University of Hong Kong(香港大学)
Leveraging Large Language Models for Relevance Judgments in Legal Case Retrieval
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学耿丽人工智能学院);Beijing Normal University(北京师范大学);DataArc Tech Ltd.(数据弧科技有限公司);Huawei Cloud BU(华为云业务单元)
Brains vs. Bytes: Evaluating LLM Proficiency in Olympiad Mathematics
Pennsylvania State University(宾夕法尼亚州立大学);City University of New york(纽约城市大学);New York University(纽约大学);Amirkabir University of Technology(阿米尔卡比尔理工大学);Bocconi University(博科尼大学);Autodesk(欧特克公司)
Competence Assessment as an Expert System for Human Resource Management: A Mathematical Approach
Institute of Knowledge Based Systems, University of Siegen(锡根大学知识基础系统研究所);Aristotle University of Thessaloniki(亚里士多德塞萨洛尼基大学);T.E.I. of Thessaly(塞萨利技术教育学院)