大模型推理能力

Improve Student's Reasoning Generalizability through Cascading Decomposed CoTs Distillation

Chengwei Dai, Kun Li, Wei Zhou, Songlin Hu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Understanding Transformer Reasoning Capabilities via Graph Algorithms

Clayton Sanford, Bahare Fatemi, Ethan Hall, Anton Tsitsulin, Mehran Kazemi, Jonathan Halcrow, Bryan Perozzi, Vahab Mirrokni

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 43 pages, 8 figures

MindMerger: Efficient Boosting LLM Reasoning in non-English Languages

Zixian Huang, Wenhao Zhu, Gong Cheng, Lei Li, Fei Yuan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Reframing Spatial Reasoning Evaluation in Language Models: A Real-World Simulation Benchmark for Qualitative Reasoning

Fangjun Li, David C. Hogg, Anthony G. Cohn

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Camera-Ready version for IJCAI 2024

SOK-Bench: A Situated Video Reasoning Benchmark with Aligned Open-World Knowledge

Andong Wang, Bo Wu, Sunli Chen, Zhenfang Chen, Haotian Guan, Wei-Ning Lee, Li Erran Li, Chuang Gan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments CVPR

Humor Mechanics: Advancing Humor Generation with Multistep Reasoning

Alexey Tikhonov, Pavel Shtykovskiy

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ICCC 2024

G-SAP: Graph-based Structure-Aware Prompt Learning over Heterogeneous Knowledge for Commonsense Reasoning

Ruiting Dai, Yuqiao Tan, Lisi Mo, Shuang Liang, Guohao Huo, Jiayi Luo, Yao Cheng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

CMMU: A Benchmark for Chinese Multi-modal Multi-type Question Understanding and Reasoning

Zheqi He, Xinya Wu, Pengfei Zhou, Richeng Xuan, Guang Liu, Xi Yang, Qiannan Zhu, Hua Huang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Can't say cant? Measuring and Reasoning of Dark Jargons in Large Language Models

Xu Ji, Jianyi Zhang, Ziyin Zhou, Zhangchi Zhao, Qianqian Qiao, Kaiying Han, Md Imran Hossen, Xiali Hei

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Improving Language Model Reasoning with Self-motivated Learning

Yunlong Feng, Yang Xu, Libo Qin, Yasheng Wang, Wanxiang Che

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted at LREC-COLING 2024

Evaluating Consistency and Reasoning Capabilities of Large Language Models

Yash Saxena, Sarthak Chopra, Arunendra Mani Tripathi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Intellecta Cognitiva: A Comprehensive Dataset for Advancing Academic Knowledge and Machine Reasoning

Ajmal PS, Ditto PS, Jithin VG

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

ScoNe: Benchmarking Negation Reasoning in Language Models With Fine-Tuning and In-Context Learning

Jingyuan Selena She, Christopher Potts, Samuel R. Bowman, Atticus Geiger

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

CBR-RAG: Case-Based Reasoning for Retrieval Augmented Generation in LLMs for Legal Question Answering

Nirmalie Wiratunga, Ramitha Abeyratne, Lasal Jayawardena, Kyle Martin, Stewart Massie, Ikechukwu Nkisi-Orji, Ruvan Weerasinghe, Anne Liret, Bruno Fleisch

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Submitted to ICCBR'24

Deceptive Semantic Shortcuts on Reasoning Chains: How Far Can Models Go without Hallucination?

Bangzheng Li, Ben Zhou, Fei Wang, Xingyu Fu, Dan Roth, Muhao Chen

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Work accepted by NAACL 2024

TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in LLMs through Translation-Assisted Chain-of-Thought Processes

Bibek Upadhayay, Vahid Behzadan

专题命中 推理评测 ：chain-of-thought(title,abstract)；分类 cs.CL、cs.AI

Enhance Reasoning for Large Language Models in the Game Werewolf

Shuang Wu, Liwen Zhu, Tao Yang, Shiwei Xu, Qiang Fu, Yang Wei, Haobo Fu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Reasoning or Reciting? Exploring the Capabilities and Limitations of Language Models Through Counterfactual Tasks

Zhaofeng Wu, Linlu Qiu, Alexis Ross, Ekin Akyürek, Boyuan Chen, Bailin Wang, Najoung Kim, Jacob Andreas, Yoon Kim

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments NAACL 2024

Evaluation of ChatGPT Family of Models for Biomedical Reasoning and Classification

Shan Chen, Yingya Li, Sheng Lu, Hoang Van, Hugo JWL Aerts, Guergana K. Savova, Danielle S. Bitterman

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 28 pages, 2 tables and 4 figures. Submitting for review

BaRDa: A Belief and Reasoning Dataset that Separates Factual Accuracy and Reasoning Ability

Peter Clark, Bhavana Dalvi Mishra, Oyvind Tafjord

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Added note about how dataset sampling was performed

ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classification

Sehee Lim, Yejin Kim, Chi-Hyun Choi, Jy-yong Sohn, Byung-Hoon Kim

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Surfer: Progressive Reasoning with World Models for Robotic Manipulation

Pengzhen Ren, Kaidong Zhang, Hetao Zheng, Zixuan Li, Yuhang Wen, Fengda Zhu, Mas Ma, Xiaodan Liang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Functional Benchmarks for Robust Evaluation of Reasoning Performance, and the Reasoning Gap

Saurabh Srivastava, Annarose M B, Anto P, Shashank Menon, Ajay Sukumar, Adwaith Samod T, Alan Philipose, Stevin Prince, Sooraj Thomas

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 37 pages, 10 figures

RJUA-MedDQA: A Multimodal Benchmark for Medical Document Question Answering and Clinical Reasoning

Congyun Jin, Ming Zhang, Xiaowei Ma, Li Yujiao, Yingbo Wang, Yabo Jia, Yuliang Du, Tao Sun, Haowen Wang, Cong Fan, Jinjie Gu, Chenfei Chi, Xiangguo Lv, Fangzhou Li, Wei Xue, Yiran Huang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 15 pages, 13 figures

Heterogeneous Graph Reasoning for Fact Checking over Texts and Tables

Haisong Gong, Weizhi Xu, Shu wu, Qiang Liu, Liang Wang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by 38th Association for the Advancement of Artificial Intelligence, AAAI

Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoning

Yiqi Wang, Wentao Chen, Xiaotian Han, Xudong Lin, Haiteng Zhao, Yongfei Liu, Bohan Zhai, Jianbo Yuan, Quanzeng You, Hongxia Yang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

DCR-Consistency: Divide-Conquer-Reasoning for Consistency Evaluation and Improvement of Large Language Models

Wendi Cui, Jiaxin Zhang, Zhuohang Li, Lopez Damien, Kamalika Das, Bradley Malin, Sricharan Kumar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Gemini in Reasoning: Unveiling Commonsense in Multimodal Large Language Models

Yuqing Wang, Yun Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Data and results are available at: https://github.com/EternityYW/Gemini-Commonsense-Evaluation/

Comparing Humans, GPT-4, and GPT-4V On Abstraction and Reasoning Tasks

Melanie Mitchell, Alessandro B. Palmarini, Arseny Moskvichev

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments Corrected Figure 3 (extra spaces were replaced by commas, which were lost in original formatting)

Journal ref Proceedings of the LLM-CP Workshop, AAAI 2024

Does Visual Pretraining Help End-to-End Reasoning?

Chen Sun, Calvin Luo, Xingyi Zhou, Anurag Arnab, Cordelia Schmid

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2023