'Actions' play a vital role in how humans interact with the world and enable them to achieve desired goals. As a result, most common sense (CS) knowledge for humans revolves around actions. While 'Reasoning about Actions & Change' (RAC) has been widely studied in the Knowledge Representation community, it has recently piqued the interest of NLP and computer vision researchers. This paper surveys existing tasks, benchmark datasets, various techniques and models, and their respective performance concerning advancements in RAC in the vision and language domain. Towards the end, we summarize our key takeaways, discuss the present challenges facing this research area, and outline potential directions for future research.
Neo-Classic: A Benchmark for Evaluating Linguistic-Aesthetic Reasoning in Classical Chinese Poetry
Shanghai Jiao Tong University(上海交通大学);Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Reasoning over Grammar: Can Synthetic Linguistic Reasoning Traces Enhance Low-Resource Machine Translation?
ELLIS Institute Finland(芬兰ELLIS研究所);University of Turku(图尔库大学);Center for Information and Language Processing, LMU Munich(慕尼黑大学信息与语言处理中心);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
Are LLMs Stable Formal Logic Translators in Logical Reasoning Across Linguistically Diversified Texts?
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China(认知智能国家重点实验室,中国科学技术大学);School of Computer Science and Technology, University of Science and Technology of China(计算机科学与技术学院,中国科学技术大学);School of Information Science and Technology, University of Science and Technology of China(信息科学与技术学院,中国科学技术大学)
The IOL-AI Challenge: An Open Challenge towards Advancing Linguistic Reasoning
University College London(伦敦大学学院);Meta;CentraleSupélec(中央高等电力学院);McGill University(麦吉尔大学);Cohere Labs(Cohere实验室);Princeton University(普林斯顿大学);University of Amsterdam(阿姆斯特丹大学);Stockholm University(斯德哥尔摩大学);Faculty of Liberal Arts and Sciences(文理学院);Universidade Federal de Goiás(戈亚斯联邦大学)
UNVEILING: What Makes Linguistics Olympiad Puzzles Tricky for LLMs?
Mohamed Bin Zayed University of Artificial Intelligence(Mohamed Bin Zayed人工智能大学);IIT Gandhinagar(印度加尔各答理工学院);Harvard University(哈佛大学);VinUniversity(文大学);Universitas Indonesia(印度尼西亚大学)
Investigating the interaction of linguistic and mathematical reasoning in language models using multilingual number puzzles
School of Engineering and Applied Sciences, Harvard University(哈佛大学工程与应用科学学院);Department of Linguistics, Harvard University(哈佛大学语言学系);Kempner Institute for the Study of Natural and Artificial Intelligence at Harvard University(哈佛大学凯普纳自然与人工智能研究 institute)
Putting a Spin on Language: A Quantum Interpretation of Unary Connectives for Linguistic Applications
Institute for Theoretical Physics(理论物理研究所);Center for Complex Systems Studies(复杂系统研究中心);Utrecht University(乌得勒支大学);Utrecht Institute of Linguistics OTS(乌得勒支语言学研究所OTS)
MathMist: A Parallel Multilingual Benchmark Dataset for Mathematical Problem Solving and Reasoning
BRAC University(布拉克大学);United International University(国际联合大学);Qatar Computing Research Institute(卡塔尔计算研究所);Center for Computational & Data Sciences, Independent University, Bangladesh(计算与数据科学中心,独立大学,孟加拉国);Amazon GenAI(亚马逊生成人工智能);University of Virginia(弗吉尼亚大学)
The Sword, Shield, and Achilles' Heel: Characterizing the Linguistic Inductive Bias of Large Language Models for Spatial Reasoning in Navigation Planning
East China Normal University(东华大学);Information Engineering University(信息工程大学);Zhengzhou University(郑州大学)
Collaborative Reasoning on Multi-Modal Semantic Graphs for Video-Grounded Dialogue Generation
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Center for Data Science, AAIS, Peking University(北京大学人工智能研究院数据科学中心);Beijing Institute for General Artificial Intelligence(北京通用人工智能研究院)
How Well Does Mathematical Reasoning Transfer Across Languages in English-Centric LLMs?
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所)
Symbolic Intermediaries as a Linguistic-Numerical Interface for LLM-Driven Geometric Reasoning
Idiap Research Institute(Idiap研究 institute);École Polytechnique Fédérale de Lausanne(瑞士联邦理工学院);Honda Research Institute Europe(本田欧洲研究院);Department of Computer Science, University of Manchester(曼彻斯特大学计算机科学系);National Biomarker Centre, CRUK-MI, University of Manchester(曼彻斯特大学国家生物标记中心)
LiTEx: A Linguistic Taxonomy of Explanations for Understanding Within-Label Variation in Natural Language Inference
MaiNLP, Center for Information and Language Processing, LMU Munich(慕尼黑大学信息与语言处理中心 MaiNLP);Munich Center for Machine Learning(慕尼黑机器学习中心);FNRS, CENTAL, UCLouvain(比利时法语区科学研究基金、鲁汶大学自然语言处理中心);Faculty of Computer Science and UniVie Doctoral School Computer Science, University of Vienna(维也纳大学计算机科学学院与维也纳大学计算机科学博士学院)