大模型推理能力

Beyond Guilt: Legal Judgment Prediction with Trichotomous Reasoning

Kepu Zhang, Haoyue Yang, Xu Tang, Weijie Yu, Jun Xu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Are Rules Meant to be Broken? Understanding Multilingual Moral Reasoning as a Computational Pipeline with UniMoral

Shivani Kumar, David Jurgens

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 21 pages, 10 figures, 8 tables

STEER-ME: Assessing the Microeconomic Reasoning of Large Language Models

Narun Raman, Taylor Lundy, Thiago Amin, Jesse Perla, Kevin Leyton-Brown

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 18 pages, 11 figures

Can Multimodal LLMs do Visual Temporal Understanding and Reasoning? The answer is No!

Mohamed Fazli Imam, Chenyang Lyu, Alham Fikri Aji

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Our dataset can be found at \url{https://huggingface.co/datasets/fazliimam/temporal-vqa}

Pixel-Level Reasoning Segmentation via Multi-turn Conversations

Dexian Cai, Xiaocui Yang, Yongkang Liu, Daling Wang, Shi Feng, Yifei Zhang, Soujanya Poria

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Medicine on the Edge: Comparative Performance Analysis of On-Device LLMs for Clinical Reasoning

Leon Nissen, Philipp Zagar, Vishnu Ravi, Aydin Zahedivash, Lara Marie Reimer, Stephan Jonas, Oliver Aalami, Paul Schmiedmayer

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

The Danger of Overthinking: Examining the Reasoning-Action Dilemma in Agentic Tasks

Alejandro Cuadron, Dacheng Li, Wenjie Ma, Xingyao Wang, Yichuan Wang, Siyuan Zhuang, Shu Liu, Luis Gaspar Schroeder, Tian Xia, Huanzhi Mao, Nicholas Thumiger, Aditya Desai, Ion Stoica, Ana Klimovic, Graham Neubig, Joseph E. Gonzalez

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

ACCESS : A Benchmark for Abstract Causal Event Discovery and Reasoning

Vy Vo, Lizhen Qu, Tao Feng, Yuncheng Hua, Xiaoxi Kang, Songhai Fan, Tim Dwyer, Lay-Ki Soon, Gholamreza Haffari

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Journal ref Proceedings of the 2025 Conference of the North American Chapter of the Association for Computational Linguistics

Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning

Rujing Yao, Yang Wu, Chenghao Wang, Jingwei Xiong, Fang Wang, Xiaozhong Liu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning

Julian Perry, Surasakdi Siripong, Thanakorn Phonchai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

What Are They Doing? Joint Audio-Speech Co-Reasoning

Yingzhi Wang, Pooneh Mousavi, Artem Ploujnikov, Mirco Ravanelli

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to ICASSP 2025

ToolComp: A Multi-Tool Reasoning & Process Supervision Benchmark

Vaskar Nath, Pranav Raja, Claire Yoon, Sean Hendryx

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoning

Zheng Li, Yang Du, Mao Zheng, Mingyang Song

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by COLING 2025

OpenRFT: Adapting Reasoning Foundation Model for Domain-specific Tasks with Reinforcement Fine-Tuning

Yuxiang Zhang, Yuqi Yang, Jiangming Shu, Yuhang Wang, Jinlin Xiao, Jitao Sang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Models

Yucheng Zhou, Zhi Rao, Jun Wan, Jianbing Shen

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

QUENCH: Measuring the gap between Indic and Non-Indic Contextual General Reasoning in LLMs

Mohammad Aflah Khan, Neemesh Yadav, Sarah Masud, Md. Shad Akhtar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 17 Pages, 6 Figures, 8 Tables, COLING 2025

Thai Winograd Schemas: A Benchmark for Thai Commonsense Reasoning

Phakphum Artkaew

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to SEALP 2025 Workshop

From Laws to Motivation: Guiding Exploration through Law-Based Reasoning and Rewards

Ziyu Chen, Zhiqing Xiao, Xinbei Jiang, Junbo Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

What Do Learning Dynamics Reveal About Generalization in LLM Reasoning?

Katie Kang, Amrith Setlur, Dibya Ghosh, Jacob Steinhardt, Claire Tomlin, Sergey Levine, Aviral Kumar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

GRS-QA -- Graph Reasoning-Structured Question Answering Dataset

Anish Pahilajani, Devasha Trivedi, Jincen Shuai, Khin S. Yone, Samyak Rajesh Jain, Namyong Park, Ryan A. Rossi, Nesreen K. Ahmed, Franck Dernoncourt, Yu Wang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 15 pages, 24 figures, 10 tables

MME-Finance: A Multimodal Finance Benchmark for Expert-level Understanding and Reasoning

Ziliang Gan, Yu Lu, Dong Zhang, Haohan Li, Che Liu, Jian Liu, Ji Liu, Haipang Wu, Chaoyou Fu, Zenglin Xu, Rongjunchen Zhang, Yong Dai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Project Page: https://hithink-research.github.io/MME-Finance/

Emotion-LLaMA: Multimodal Emotion Recognition and Reasoning with Instruction Tuning

Zebang Cheng, Zhi-Qi Cheng, Jun-Yan He, Jingdong Sun, Kai Wang, Yuxiang Lin, Zheng Lian, Xiaojiang Peng, Alexander Hauptmann

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted at NeurIPS 2024. 49 pages, 13 figures, Project: https://github.com/ZebangCheng/Emotion-LLaMA, Demo: https://huggingface.co/spaces/ZebangCheng/Emotion-LLaMA

LINGOLY: A Benchmark of Olympiad-Level Linguistic Reasoning Puzzles in Low-Resource and Extinct Languages

Andrew M. Bean, Simi Hellsten, Harry Mayne, Jabez Magomere, Ethan A. Chi, Ryan Chi, Scott A. Hale, Hannah Rose Kirk

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Oral presentation at NeurIPS 2024 Datasets and Benchmarks Track. 10 pages, 5 figures, 22 pages supplemental materials

GITA: Graph to Visual and Textual Integration for Vision-Language Graph Reasoning

Yanbin Wei, Shuai Fu, Weisen Jiang, Zejian Zhang, Zhixiong Zeng, Qi Wu, James T. Kwok, Yu Zhang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments NeurIPS 2024; Project Page: v-graph.github.io; Code: https://github.com/WEIYanbin1999/GITA/

CLR-Bench: Evaluating Large Language Models in College-level Reasoning

Junnan Dong, Zijin Hong, Yuanchen Bei, Feiran Huang, Xinrun Wang, Xiao Huang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 18 pages, 6 figures, dataset and evaluation framework will be opensourced

Message Intercommunication for Inductive Relation Reasoning

Ke Liang, Lingyuan Meng, Sihang Zhou, Siwei Wang, Wenxuan Tu, Yue Liu, Meng Liu, Xinwang Liu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments This work has been submitted to the IEEE for possible publication

Selective Vision is the Challenge for Visual Reasoning: A Benchmark for Visual Argument Understanding

Jiwan Chung, Sungjae Lee, Minseo Kim, Seungju Han, Ashkan Yousefpour, Jack Hessel, Youngjae Yu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 12 pages, 6 figures. Accepted as main paper in EMNLP 2024

Self-Contradictory Reasoning Evaluation and Detection

Ziyi Liu, Soumya Sanyal, Isabelle Lee, Yongkang Du, Rahul Gupta, Yang Liu, Jieyu Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Belief Revision: The Adaptability of Large Language Models Reasoning

Bryan Wilie, Samuel Cahyawijaya, Etsuko Ishii, Junxian He, Pascale Fung

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Adaptive Reasoning and Acting in Medical Language Agents

Abhishek Dutta, Yen-Che Hsiao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI