大模型推理能力

A Theoretically Grounded Benchmark for Evaluating Machine Commonsense

Henrique Santos, Ke Shen, Alice M. Mulvehill, Yasaman Razeghi, Deborah L. McGuinness, Mayank Kejriwal

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

A Novel DeBERTa-based Model for Financial Question Answering Task

Yanbo J. Wang, Yuming Li, Hui Qin, Yuhang Guan, Sheng Chen

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 6 pages,3 figures,conference

CUP: Curriculum Learning based Prompt Tuning for Implicit Event Argument Extraction

Jiaju Lin, Qin Chen, Jie Zhou, Jian Jin, Liang He

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accpeted by IJCAI 2022

Plot Writing From Pre-Trained Language Models

Yiping Jin, Vishakha Kadam, Dittaya Wanvarie

专题命中 推理评测 ：planning(abstract)；分类 cs.CL

Comments Accepted to INLG 2022; 16 pages, 11 figures

A-OKVQA: A Benchmark for Visual Question Answering using World Knowledge

Dustin Schwenk, Apoorv Khandelwal, Christopher Clark, Kenneth Marino, Roozbeh Mottaghi

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Meet MASKS: A novel Multi-Classifier's verification approach

Amirhoshang Hoseinpour Dehkordi, Majid Alizadeh, Ali Movaghar

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 34 pages, 12 figures, 1 table

'Just because you are right, doesn't mean I am wrong': Overcoming a Bottleneck in the Development and Evaluation of Open-Ended Visual Question Answering (VQA) Tasks

Man Luo, Shailaja Keyur Sampat, Riley Tallman, Yankai Zeng, Manuha Vancha, Akarshan Sajja, Chitta Baral

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments accepted to EACL 2021

Semantic-Enhanced Explainable Finetuning for Open-Domain Dialogues

Yinhe Zheng, Yida Wang, Pei Ke, Zhenyu Yang, Minlie Huang

专题命中 推理评测 ：planning(abstract)；分类 cs.CL

Comments Under review

How Does Data Corruption Affect Natural Language Understanding Models? A Study on GLUE datasets

Aarne Talman, Marianna Apidianaki, Stergios Chatzikyriakidis, Jörg Tiedemann

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments *SEM 2022 camera ready version

Predicting Human Psychometric Properties Using Computational Language Models

Antonio Laverghetta, Animesh Nighojkar, Jamshidbek Mirzakhalov, John Licato

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments To appear in Quantitative Psychology, The 86th Annual Meeting of the Psychometric Society, Virtual. arXiv admin note: substantial text overlap with arXiv:2106.06849

ElitePLM: An Empirical Study on General Language Ability Evaluation of Pretrained Language Models

Junyi Li, Tianyi Tang, Zheng Gong, Lixin Yang, Zhuohao Yu, Zhipeng Chen, Jingyuan Wang, Wayne Xin Zhao, Ji-Rong Wen

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by NAACL 2022 main conference (Long Paper)

Developmental Negation Processing in Transformer Language Models

Antonio Laverghetta, John Licato

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments To appear as a short paper at ACL 2022

QRelScore: Better Evaluating Generated Questions with Deeper Understanding of Context-aware Relevance

Xiaoqiang Wang, Bang Liu, Siliang Tang, Lingfei Wu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 16 pages, 7 figures

Things not Written in Text: Exploring Spatial Commonsense from Visual Signals

Xiao Liu, Da Yin, Yansong Feng, Dongyan Zhao

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ACL 2022 main conference

Winoground: Probing Vision and Language Models for Visio-Linguistic Compositionality

Tristan Thrush, Ryan Jiang, Max Bartolo, Amanpreet Singh, Adina Williams, Douwe Kiela, Candace Ross

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments CVPR 2022

Improving Cross-Modal Understanding in Visual Dialog via Contrastive Learning

Feilong Chen, Xiuyi Chen, Shuang Xu, Bo Xu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments ICASSP 2022

KOBEST: Korean Balanced Evaluation of Significant Tasks

Dohyeong Kim, Myeongjun Jang, Deuk Sin Kwon, Eric Davis

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 9 pages

AutoMO-Mixer: An automated multi-objective Mixer model for balanced, safe and robust prediction in medicine

Xi Chen, Jiahuan Lv, Dehua Feng, Xuanqin Mou, Ling Bai, Shu Zhang, Zhiguo Zhou

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

TorchDrug: A Powerful and Flexible Machine Learning Platform for Drug Discovery

Zhaocheng Zhu, Chence Shi, Zuobai Zhang, Shengchao Liu, Minghao Xu, Xinyu Yuan, Yangtian Zhang, Junkun Chen, Huiyu Cai, Jiarui Lu, Chang Ma, Runcheng Liu, Louis-Pascal Xhonneux, Meng Qu, Jian Tang

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

DACBench: A Benchmark Library for Dynamic Algorithm Configuration

Theresa Eimer, André Biedenkapp, Maximilian Reimer, Steven Adriaensen, Frank Hutter, Marius Lindauer

专题命中 推理评测 ：planning(abstract)；分类 cs.AI

Comments Accepted at IJCAI 2021

Journal ref 30th International Joint Conference on Artificial Intelligence (IJCAI 2021)

ObjectFolder: A Dataset of Objects with Implicit Visual, Auditory, and Tactile Representations

Ruohan Gao, Yen-Yu Chang, Shivani Mall, Li Fei-Fei, Jiajun Wu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments In CoRL 2021. Chang and Mall contributed equally to this work. Project page: https://ai.stanford.edu/~rhgao/objectfolder/

Towards Dynamic Consistency Checking in Goal-directed Predicate Answer Set Programming

Joaquín Arias, Manuel Carro, Gopal Gupta

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments Submitted to PADL'22. arXiv admin note: text overlap with arXiv:2106.14566

Challenges in Procedural Multimodal Machine Comprehension:A Novel Way To Benchmark

Pritish Sahu, Karan Sikka, Ajay Divakaran

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

On-the-Fly Attention Modulation for Neural Generation

Yue Dong, Chandra Bhagavatula, Ximing Lu, Jena D. Hwang, Antoine Bosselut, Jackie Chi Kit Cheung, Yejin Choi

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 10 pages, 3 figures

ALL Dolphins Are Intelligent and SOME Are Friendly: Probing BERT for Nouns' Semantic Properties and their Prototypicality

Marianna Apidianaki, Aina Garí Soler

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to BlackboxNLP 2021

Does External Knowledge Help Explainable Natural Language Inference? Automatic Evaluation vs. Human Ratings

Hendrik Schuff, Hsiu-Yu Yang, Heike Adel, Ngoc Thang Vu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments BlackboxNLP @ EMNLP2021

Back to Square One: Artifact Detection, Training and Commonsense Disentanglement in the Winograd Schema

Yanai Elazar, Hongming Zhang, Yoav Goldberg, Dan Roth

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2021

From Known to Unknown: Knowledge-guided Transformer for Time-Series Sales Forecasting in Alibaba

Xinyuan Qi, Kai Hou, Tong Liu, Zhongzhong Yu, Sihao Hu, Wenwu Ou

专题命中 推理评测 ：planning(abstract)；分类 cs.LG

Comments 8 pages, 7 figure

RockNER: A Simple Method to Create Adversarial Examples for Evaluating the Robustness of Named Entity Recognition Models

Bill Yuchen Lin, Wenyang Gao, Jun Yan, Ryan Moreno, Xiang Ren

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2021 as a short paper. Project website: https://inklab.usc.edu/rockner/

NUANCED: Natural Utterance Annotation for Nuanced Conversation with Estimated Distributions

Zhiyu Chen, Honglei Liu, Hu Xu, Seungwhan Moon, Hao Zhou, Bing Liu

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments Findings of EMNLP 2021