大模型推理能力

CRASS: A Novel Data Set and Benchmark to Test Counterfactual Reasoning of Large Language Models

Jörg Frohberg, Frank Binder

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 10 pages including references, plus 5 pages appendix. Edits for version 3 vs LREC 2022: Point out human baseline in abstract (also to match arxiv abstract), fix affiliation apergo.ai, and fix a recurring typo

Journal ref Proceedings of the 13th Language Resources and Evaluation Conference (LREC 2022), Marseille, France pp. 2126-2140 (2022) https://aclanthology.org/2022.lrec-1.229/

LegalBench: Prototyping a Collaborative Benchmark for Legal Reasoning

Neel Guha, Daniel E. Ho, Julian Nyarko, Christopher Ré

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments 13 pages, 7 tables

Evaluate Confidence Instead of Perplexity for Zero-shot Commonsense Reasoning

Letian Peng, Zuchao Li, Hai Zhao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Generative Data Augmentation for Commonsense Reasoning

Yiben Yang, Chaitanya Malaviya, Jared Fernandez, Swabha Swayamdipta, Ronan Le Bras, Ji-Ping Wang, Chandra Bhagavatula, Yejin Choi, Doug Downey

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Findings of the Association for Computational Linguistics: EMNLP 2020

Relevant CommonSense Subgraphs for "What if..." Procedural Reasoning

Chen Zheng, Parisa Kordjamshidi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted by ACL 2022 findings short paper

Tiered Reasoning for Intuitive Physics: Toward Verifiable Commonsense Language Understanding

Shane Storks, Qiaozi Gao, Yichi Zhang, Joyce Chai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to Findings of EMNLP 2021

KMIR: A Benchmark for Evaluating Knowledge Memorization, Identification and Reasoning Abilities of Language Models

Daniel Gao, Yantao Jia, Lei Li, Chengzhen Fu, Zhicheng Dou, Hao Jiang, Xinyu Zhang, Lei Chen, Zhao Cao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical Reasoning

Jiaqi Chen, Jianheng Tang, Jinghui Qin, Xiaodan Liang, Lingbo Liu, Eric P. Xing, Liang Lin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted to Findings of ACL 2021

Discovering Emotion and Reasoning its Flip in Multi-Party Conversations using Masked Memory Network and Transformer

Shivani Kumar, Anubhav Shrimal, Md Shad Akhtar, Tanmoy Chakraborty

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted in Knowledge-Based Systems; 34 pages, 4 figures, 15 tables

Reasoning Chain Based Adversarial Attack for Multi-hop Question Answering

Jiayu Ding, Siyuan Wang, Qin Chen, Zhongyu Wei

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 10 pages including reference, 4 figures

Answering Open-Domain Questions of Varying Reasoning Steps from Text

Peng Qi, Haejun Lee, Oghenetegiri "TG" Sido, Christopher D. Manning

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments EMNLP 2021. Peng Qi, Haejun Lee, and TG Sido contributed equally

Leveraging Knowledge in Multilingual Commonsense Reasoning

Yuwei Fang, Shuohang Wang, Yichong Xu, Ruochen Xu, Siqi Sun, Chenguang Zhu, Michael Zeng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments First place in XCSR Leaderboard: https://inklab.usc.edu//XCSR/leaderboard. Work in progress

L2R2: Leveraging Ranking for Abductive Reasoning

Yunchang Zhu, Liang Pang, Yanyan Lan, Xueqi Cheng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments SIGIR 2020

Is Multi-Hop Reasoning Really Explainable? Towards Benchmarking Reasoning Interpretability

Xin Lv, Yixin Cao, Lei Hou, Juanzi Li, Zhiyuan Liu, Yichi Zhang, Zelin Dai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Exploring Strategies for Generalizable Commonsense Reasoning with Pre-trained Models

Kaixin Ma, Filip Ilievski, Jonathan Francis, Satoru Ozaki, Eric Nyberg, Alessandro Oltramari

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments EMNLP 2021

Hybrid Reasoning Network for Video-based Commonsense Captioning

Weijiang Yu, Jian Liang, Lei Ji, Lu Li, Yuejian Fang, Nong Xiao, Nan Duan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 11 pages, 6 figures

Communicative Message Passing for Inductive Relation Reasoning

Sijie Mai, Shuangjia Zheng, Yuedong Yang, Haifeng Hu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI

Comments Accepted by AAAI-2021

TIMEDIAL: Temporal Commonsense Reasoning in Dialog

Lianhui Qin, Aditya Gupta, Shyam Upadhyay, Luheng He, Yejin Choi, Manaal Faruqui

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

PROST: Physical Reasoning of Objects through Space and Time

Stéphane Aroca-Ouellette, Cory Paik, Alessandro Roncone, Katharina Kann

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted to ACL-Findings 2021, 9 Pages

Temporal Reasoning on Implicit Events from Distant Supervision

Ben Zhou, Kyle Richardson, Qiang Ning, Tushar Khot, Ashish Sabharwal, Dan Roth

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted at NAACL 2021

UNICORN on RAINBOW: A Universal Commonsense Reasoning Model on a New Multitask Benchmark

Nicholas Lourie, Ronan Le Bras, Chandra Bhagavatula, Yejin Choi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 27 pages, 19 figures, 34 tables. Accepted to AAAI 2021. For associated code and data see https://github.com/allenai/rainbow

Improving Commonsense Causal Reasoning by Adversarial Training and Data Augmentation

Ieva Staliūnaitė, Philip John Gorinski, Ignacio Iacobacci

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 7 pages + pages references, 4 figures, 3 tables, paper accepted at AAAI2021

Learning to Rationalize for Nonmonotonic Reasoning with Distant Supervision

Faeze Brahman, Vered Shwartz, Rachel Rudinger, Yejin Choi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments AAAI 2021

Reasoning in Dialog: Improving Response Generation by Context Reading Comprehension

Xiuying Chen, Zhi Cui, Jiayi Zhang, Chen Wei, Jianwei Cui, Bin Wang, Dongyan Zhao, Rui Yan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 9 pages, 1 figure

Journal ref AAAI 2021

Reasoning about Goals, Steps, and Temporal Ordering with WikiHow

Li Zhang, Qing Lyu, Chris Callison-Burch

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments In EMNLP 2020

Journal ref Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (2020) 4630-4639

Graph-based Multi-hop Reasoning for Long Text Generation

Liang Zhao, Jingjing Xu, Junyang Lin, Yichang Zhang, Hongxia Yang, Xu Sun

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Abductive Commonsense Reasoning

Chandra Bhagavatula, Ronan Le Bras, Chaitanya Malaviya, Keisuke Sakaguchi, Ari Holtzman, Hannah Rashkin, Doug Downey, Scott Wen-tau Yih, Yejin Choi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments ICLR 2020 Camera Ready

SocialIQA: Commonsense Reasoning about Social Interactions

Maarten Sap, Hannah Rashkin, Derek Chen, Ronan LeBras, Yejin Choi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments the first two authors contributed equally; accepted to EMNLP 2019; camera ready version

A Hybrid Neural Network Model for Commonsense Reasoning

Pengcheng He, Xiaodong Liu, Weizhu Chen, Jianfeng Gao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments 9 pages, 3 figures, 6 tables

Explain Yourself! Leveraging Language Models for Commonsense Reasoning

Nazneen Fatema Rajani, Bryan McCann, Caiming Xiong, Richard Socher

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL

Comments Accepted at ACL, 11 pages total

Journal ref In Proceedings of the Association for Computational Linguistics (ACL), 2019. Florence, Italy