大模型推理能力

Prompt Engineering and Calibration for Zero-Shot Commonsense Reasoning

Chenkai Ma

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments To be published in the ICLR TinyPaper track

Multi-Viewpoint and Multi-Evaluation with Felicitous Inductive Bias Boost Machine Abstract Reasoning Ability

Qinglai Wei, Diancheng Chen, Beiming Yuan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Impact of Pretraining Term Frequencies on Few-Shot Reasoning

Yasaman Razeghi, Robert L. Logan, Matt Gardner, Sameer Singh

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Lila: A Unified Benchmark for Mathematical Reasoning

Swaroop Mishra, Matthew Finlayson, Pan Lu, Leonard Tang, Sean Welleck, Chitta Baral, Tanmay Rajpurohit, Oyvind Tafjord, Ashish Sabharwal, Peter Clark, Ashwin Kalyan

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2022

Implicit Temporal Reasoning for Evidence-Based Fact-Checking

Liesbeth Allein, Marlon Saelens, Ruben Cartuyvels, Marie-Francine Moens

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments The 17th Conference of the European Chapter of the Association for Computational Linguistics (EACL 2023, Findings)

STREET: A Multi-Task Structured Reasoning and Explanation Benchmark

Danilo Ribeiro, Shen Wang, Xiaofei Ma, Henry Zhu, Rui Dong, Deguang Kong, Juliette Burger, Anjelica Ramos, William Wang, Zhiheng Huang, George Karypis, Bing Xiang, Dan Roth

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Published in ICLR 2023

DR.BENCH: Diagnostic Reasoning Benchmark for Clinical Natural Language Processing

Yanjun Gao, Dmitriy Dligach, Timothy Miller, John Caskey, Brihat Sharma, Matthew M Churpek, Majid Afshar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Under review

Phy-Q as a measure for physical reasoning intelligence

Cheng Xue, Vimukthini Pinto, Chathura Gamage, Ekaterina Nikonova, Peng Zhang, Jochen Renz

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments For the associated website, see https://github.com/phy-q/benchmark

Utilizing Background Knowledge for Robust Reasoning over Traffic Situations

Jiarui Zhang, Filip Ilievski, Aravinda Kollaa, Jonathan Francis, Kaixin Ma, Alessandro Oltramari

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Camera ready version of AAAI 2023 workshop on Knowledge-Augmented Methods for Natural Language Processing

TRAC: A Textual Benchmark for Reasoning about Actions and Change

Weinan He, Canming Huang, Zhanhao Xiao, Yongmei Liu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Template Filling for Controllable Commonsense Reasoning

Dheeraj Rajagopal, Vivek Khetan, Bogdan Sacaleanu, Anatole Gershman, Andrew Fano, Eduard Hovy

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Mind's Eye: Grounded Language Model Reasoning through Simulation

Ruibo Liu, Jason Wei, Shixiang Shane Gu, Te-Yen Wu, Soroush Vosoughi, Claire Cui, Denny Zhou, Andrew M. Dai

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Possible Stories: Evaluating Situated Commonsense Reasoning under Multiple Possible Scenarios

Mana Ashida, Saku Sugawara

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to COLING 2022

EvolveHypergraph: Group-Aware Dynamic Relational Reasoning for Trajectory Prediction

Jiachen Li, Chuanbo Hua, Jinkyoo Park, Hengbo Ma, Victoria Dax, Mykel J. Kochenderfer

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

e-CARE: a New Dataset for Exploring Explainable Causal Reasoning

Li Du, Xiao Ding, Kai Xiong, Ting Liu, Bing Qin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Rethinking Offensive Text Detection as a Multi-Hop Reasoning Problem

Qiang Zhang, Jason Naradowsky, Yusuke Miyao

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 18 pages, 4 figures, 10 tables, accepted in Findings of the Association for Computational Linguistics 2022

How Much Coffee Was Consumed During EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI

Ashwin Kalyan, Abhinav Kumar, Arjun Chandrasekaran, Ashish Sabharwal, Peter Clark

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted for publication at EMNLP 2021, 11 pages, 5 tables, 4 figures

Broaden the Vision: Geo-Diverse Visual Commonsense Reasoning

Da Yin, Liunian Harold Li, Ziniu Hu, Nanyun Peng, Kai-Wei Chang

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP 2021. Code and data are available at https://github.com/WadeYin9712/GD-VCR

Hi-Phy: A Benchmark for Hierarchical Physical Reasoning

Cheng Xue, Vimukthini Pinto, Chathura Gamage, Peng Zhang, Jochen Renz

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments We have updated this paper with considerable modifications

Prompting Contrastive Explanations for Commonsense Reasoning Tasks

Bhargavi Paranjape, Julian Michael, Marjan Ghazvininejad, Luke Zettlemoyer, Hannaneh Hajishirzi

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ACL 2021 Findings

Database Reasoning Over Text

James Thorne, Majid Yazdani, Marzieh Saeidi, Fabrizio Silvestri, Sebastian Riedel, Alon Halevy

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments To appear at ACL2021

COM2SENSE: A Commonsense Reasoning Benchmark with Complementary Sentences

Shikhar Singh, Nuan Wen, Yu Hou, Pegah Alipoormolabashi, Te-Lin Wu, Xuezhe Ma, Nanyun Peng

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments In Proceedings of Findings of the Association for Computational Linguistics: ACL 2021 (ACL-Findings). Contains 16 pages, 14 figures and 11 tables

Identify, Align, and Integrate: Matching Knowledge Graphs to Commonsense Reasoning Tasks

Lisa Bauer, Mohit Bansal

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments EACL 2021 (14 pages, 2 figures, 10 tables)

ACRE: Abstract Causal REasoning Beyond Covariation

Chi Zhang, Baoxiong Jia, Mark Edmonds, Song-Chun Zhu, Yixin Zhu

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments CVPR 2021 paper. Supplementary: http://wellyzhang.github.io/attach/cvpr21zhang_acre_supp.pdf Project: http://wellyzhang.github.io/project/acre.html

Bongard-LOGO: A New Benchmark for Human-Level Concept Learning and Reasoning

Weili Nie, Zhiding Yu, Lei Mao, Ankit B. Patel, Yuke Zhu, Animashree Anandkumar

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 22 pages, NeurIPS 2020

CommonGen: A Constrained Text Generation Challenge for Generative Commonsense Reasoning

Bill Yuchen Lin, Wangchunshu Zhou, Ming Shen, Pei Zhou, Chandra Bhagavatula, Yejin Choi, Xiang Ren

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2020 Findings. Add one more human reference for each test example: Table 1,3 & Figure 4 & Section 3.3, 3.4 are updated. Project page: https://inklab.usc.edu/CommonGen/

ESPRIT: Explaining Solutions to Physical Reasoning Tasks

Nazneen Fatema Rajani, Rui Zhang, Yi Chern Tan, Stephan Zheng, Jeremy Weiss, Aadit Vyas, Abhijit Gupta, Caiming XIong, Richard Socher, Dragomir Radev

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments ACL 2020

Joint Reasoning for Multi-Faceted Commonsense Knowledge

Yohan Chalier, Simon Razniewski, Gerhard Weikum

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 11 pages

Journal ref AKBC 2020

Reasoning Over Semantic-Level Graph for Fact Checking

Wanjun Zhong, Jingjing Xu, Duyu Tang, Zenan Xu, Nan Duan, Ming Zhou, Jiahai Wang, Jian Yin

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 9pages

Heterogeneous Relational Reasoning in Knowledge Graphs with Reinforcement Learning

Mandana Saebi, Steven Krieg, Chuxu Zhang, Meng Jiang, Nitesh Chawla

专题命中 推理评测 ：reasoning(title,abstract)；分类 cs.CL、cs.LG