Logic reasoning has been critically needed in problem-solving and decision-making. Although Language Models (LMs) have demonstrated capabilities of handling multiple reasoning tasks (e.g., commonsense reasoning), their ability to reason complex mathematical problems, specifically propositional logic, remains largely underexplored. This lack of exploration can be attributed to the limited availability of annotated corpora. Here, we present a well-labeled propositional logic corpus, LogicPrpBank, containing 7093 Propositional Logic Statements (PLSs) across six mathematical subjects, to study a brand-new task of reasoning logical implication and equivalence. We benchmark LogicPrpBank with widely-used LMs to show that our corpus offers a useful resource for this challenging task and there is ample room for model improvement.
A Methodology for Creating Question Answering Corpora Using Inverse Data Annotation
Zurich University of Applied Sciences (ZHAW)(苏黎世应用科学大学(ZHAW));National Distance Education University (UNED)(国立远程教育大学(UNED));University of the Basque Country (UPV/EHU)(巴斯克大学(UPV/EHU))
Distributional Sentence Entailment Using Density Matrices
Queen Mary University of London(伦敦玛丽女王大学);University of Oxford(牛津大学)
Coecke et al.(2010)的范畴组合分布模型提出了一种将形式的类型逻辑模型的语法组合与基于语料库的分布语义的经验词表示相结合的方法。本文通过扩展模型来捕获蕴涵关系,从而为该项目做出了贡献。这是通过将词的表示从意义空间中的点扩展到密度算子来实现的,密度算子是空间子空间上的概率分布。定义了相似性的对称度量和蕴涵的非对称度量,其中词汇蕴涵使用冯·诺依曼熵(Kullback-Leibler发散的量子变体)来测量。词汇蕴涵与词表征的组合图相结合,提供了一种在句子层次上获取蕴涵关系的方法。真值理论和语料库为基础的例子。
emrQA: A Large Corpus for Question Answering on Electronic Medical Records
MIT-IBM Watson AI Lab(麻省理工学院-IBM沃森人工智能实验室);IBM TJ Watson Research Center(IBM托马斯·J·沃森研究中心);University of Illinois Urbana Champaign(伊利诺伊大学厄巴纳-香槟分校);Carle Illinois College of Medicine(伊利诺伊大学卡勒医学院)
LogicOCR: Do Your Large Multimodal Models Excel at Logical Reasoning on Text-Rich Images?
School of Computer Science, National Engineering Research Center for Multimedia Software, Institute of Artificial Intelligence, and Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University(计算机学院、多媒体软件国家工程研究中心、人工智能研究院、多媒体与网络通信工程湖北省重点实验室、武汉大学)