大模型推理能力

Empirical Study of Symmetrical Reasoning in Conversational Chatbots

Daniela N. Rim, Heeyoul Choi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted in Future Technology Conference (FTC) 2024

ALTER: Augmentation for Large-Table-Based Reasoning

Han Zhang, Yuheng Ma, Hanfang Yang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

EconNLI: Evaluating Large Language Models on Economics Reasoning

Yue Guo, Yi Yang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of ACL 2024

JMLR: Joint Medical LLM and Retrieval Training for Enhancing Reasoning and Professional Question Answering Capability

Junda Wang, Zhichao Yang, Zonghai Yao, Hong Yu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Exploring Defeasibility in Causal Reasoning

Shaobo Cui, Lazar Milikic, Yiyang Feng, Mete Ismayilzada, Debjit Paul, Antoine Bosselut, Boi Faltings

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2024 (Findings)

DARG: Dynamic Evaluation of Large Language Models via Adaptive Reasoning Graph

Zhehao Zhang, Jiaao Chen, Diyi Yang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

modeLing: A Novel Dataset for Testing Linguistic Reasoning in Language Models

Nathan A. Chi, Teodor Malchev, Riley Kong, Ryan A. Chi, Lucas Huang, Ethan A. Chi, R. Thomas McCoy, Dragomir Radev

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

MoreHopQA: More Than Multi-hop Reasoning

Julian Schnitzler, Xanh Ho, Jiahao Huang, Florian Boudin, Saku Sugawara, Akiko Aizawa

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 8 pages, 5 figures. First three authors contributed equally

RUPBench: Benchmarking Reasoning Under Perturbations for Robustness Evaluation in Large Language Models

Yuqing Wang, Yun Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments In submission; Data and code are available at: https://github.com/EternityYW/RUPBench

ReMI: A Dataset for Reasoning with Multiple Images

Mehran Kazemi, Nishanth Dikkala, Ankit Anand, Petar Devic, Ishita Dasgupta, Fangyu Liu, Bahare Fatemi, Pranjal Awasthi, Dee Guo, Sreenivas Gollapudi, Ahmed Qureshi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Test of Time: A Benchmark for Evaluating LLMs on Temporal Reasoning

Bahare Fatemi, Mehran Kazemi, Anton Tsitsulin, Karishma Malkan, Jinyeong Yim, John Palowitch, Sungyong Seo, Jonathan Halcrow, Bryan Perozzi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

MR-GSM8K: A Meta-Reasoning Benchmark for Large Language Model Evaluation

Zhongshen Zeng, Pengguang Chen, Shu Liu, Haiyun Jiang, Jiaya Jia

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Code: https://github.com/dvlab-research/MR-GSM8K

TRAM: Benchmarking Temporal Reasoning for Large Language Models

Yuqing Wang, Yun Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of ACL 2024

CANDLE: Iterative Conceptualization and Instantiation Distillation from Large Language Models for Commonsense Reasoning

Weiqi Wang, Tianqing Fang, Chunyang Li, Haochen Shi, Wenxuan Ding, Baixuan Xu, Zhaowei Wang, Jiaxin Bai, Xin Liu, Jiayang Cheng, Chunkit Chan, Yangqiu Song

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments ACL2024

RAR-b: Reasoning as Retrieval Benchmark

Chenghao Xiao, G Thomas Hudson, Noura Al Moubayed

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments v2, small typo fixes

Optimizing Language Model's Reasoning Abilities with Weak Supervision

Yongqi Tong, Sizhe Wang, Dawei Li, Yifan Wang, Simeng Han, Zi Lin, Chengsong Huang, Jiaxin Huang, Jingbo Shang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Transformer-based Reasoning for Learning Evolutionary Chain of Events on Temporal Knowledge Graph

Zhiyu Fang, Shuai-Long Lei, Xiaobin Zhu, Chun Yang, Shi-Xue Zhang, Xu-Cheng Yin, Jingyan Qin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted by SIGIR 2024 (the Full paper track, camera ready version)

Light-weight Retinal Layer Segmentation with Global Reasoning

Xiang He, Weiye Song, Yiming Wang, Fabio Poiesi, Ji Yi, Manishi Desai, Quanqing Xu, Kongzheng Yang, Yi Wan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments IEEE Transactions on Instrumentation & Measurement

MARVEL: Multidimensional Abstraction and Reasoning through Visual Evaluation and Learning

Yifan Jiang, Jiarui Zhang, Kexuan Sun, Zhivar Sourati, Kian Ahrabian, Kaixin Ma, Filip Ilievski, Jay Pujara

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuances

Haryo Akbarianto Wibowo, Erland Hilman Fuadi, Made Nindyatama Nityasya, Radityo Eko Prasojo, Alham Fikri Aji

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 8 pages, Camera Ready (NAACL 2024 - Main)

How often are errors in natural language reasoning due to paraphrastic variability?

Neha Srikanth, Marine Carpuat, Rachel Rudinger

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments accepted to TACL 2024 (pre-MIT Press publication version)

LLM-Seg: Bridging Image Segmentation and Large Language Model Reasoning

Junchi Wang, Lei Ke

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

Comments Github: https://github.com/wangjunchi/LLMSeg

Selective Temporal Knowledge Graph Reasoning

Zhongni Hou, Xiaolong Jin, Zixuan Li, Long Bai, Jiafeng Guo, Xueqi Cheng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.LG

FSMR: A Feature Swapping Multi-modal Reasoning Approach with Joint Textual and Visual Clues

Shuang Li, Jiahua Wang, Lijie Wen

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Effective Distillation of Table-based Reasoning Ability from LLMs

Bohao Yang, Chen Tang, Kun Zhao, Chenghao Xiao, Chenghua Lin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Chart-based Reasoning: Transferring Capabilities from LLMs to VLMs

Victor Carbune, Hassan Mansoor, Fangyu Liu, Rahul Aralikatte, Gilles Baechler, Jindong Chen, Abhanshu Sharma

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of NAACL 2024

ChartInstruct: Instruction Tuning for Chart Comprehension and Reasoning

Ahmed Masry, Mehrad Shahmohammadi, Md Rizwan Parvez, Enamul Hoque, Shafiq Joty

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

BizBench: A Quantitative Reasoning Benchmark for Business and Finance

Rik Koncel-Kedziorski, Michael Krumdick, Viet Lai, Varshini Reddy, Charles Lovering, Chris Tanner

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Work in progress

CLEVR-POC: Reasoning-Intensive Visual Question Answering in Partially Observable Environments

Savitha Sam Abraham, Marjan Alirezaie, Luc De Raedt

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 17 pages, 10 images, Accepted at LREC-COLING 2024 - The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation

Large Language Model-Based Evolutionary Optimizer: Reasoning with elitism

Shuvayan Brahmachary, Subodh M. Joshi, Aniruddha Panda, Kaushik Koneripalli, Arun Kumar Sagotra, Harshil Patel, Ankush Sharma, Ameya D. Jagtap, Kaushic Kalyanaraman

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI