Deep learning models such as CNNs have surpassed human performance in computer vision tasks such as image classification. However, despite their sophistication, these models lack interpretability which can lead to biased outcomes reflecting existing prejudices in the data. We aim to make predictions made by a CNN interpretable. Hence, we present a novel framework called NeSyFOLD to create a neurosymbolic (NeSy) model for image classification tasks. The model is a CNN with all layers following the last convolutional layer replaced by a stratified answer set program (ASP). A rule-based machine learning algorithm called FOLD-SE-M is used to derive the stratified answer set program from binarized filter activations of the last convolutional layer. The answer set program can be viewed as a rule-set, wherein the truth value of each predicate depends on the activation of the corresponding kernel in the CNN. The rule-set serves as a global explanation for the model and is interpretable. A justification for the predictions made by the NeSy model can be obtained using an ASP interpreter. We also use our NeSyFOLD framework with a CNN that is trained using a sparse kernel learning technique called Elite BackProp (EBP). This leads to a significant reduction in rule-set size without compromising accuracy or fidelity thus improving scalability of the NeSy model and interpretability of its rule-set. Evaluation is done on datasets with varied complexity and sizes. To make the rule-set more intuitive to understand, we propose a novel algorithm for labelling each kernel's corresponding predicate in the rule-set with the semantic concept(s) it learns. We evaluate the performance of our "semantic labelling algorithm" to quantify the efficacy of the semantic labelling for both the NeSy model and the NeSy-EBP model.
NSF-MAP: Neurosymbolic Multimodal Fusion for Robust and Interpretable Anomaly Prediction in Assembly Pipelines
Artificial Intelligence Institute, University of South Carolina(南卡罗来纳大学人工智能研究所);Clemson Composites Center, Clemson University(克莱姆森大学复合材料中心);Intelligent Circuits, Architectures and Systems Lab, University of South Carolina(南卡罗来纳大学智能电路、架构和系统实验室)
NeuroSymbolic AI for Legal AI-TRISM: Trustworthy, Reliable, Interpretable, Safe Models
Department of Computer Science, AI Institute, University of South Carolina(南卡罗来纳大学计算机科学系,人工智能研究所);Department of Computer Science and Electrical Engineering, University of Maryland, Baltimore County(马里兰大学巴尔的摩县分校计算机科学与电气工程系);Department of Computer Science and Engineering, The Ohio State University(俄亥俄州立大学计算机科学与工程系)
Neurosymbolic Framework for Concept-Driven Logical Reasoning in Skeleton-Based Human Action Recognition
Department of ECSE, Faculty of Engineering, Monash University, Australia(莫纳什大学工程学院电子与计算机工程系,澳大利亚);AIM for Health Lab, Faculty of Information Technology, Monash University, Australia(莫纳什大学信息科技学院健康人工智能实验室,澳大利亚);Department of DSAI, Faculty of Information Technology, Monash University, Australia(莫纳什大学信息科技学院数据科学与人工智能系,澳大利亚)
Neurosymbolic AI for Travel Demand Prediction: Integrating Decision Tree Rules into Neural Networks
Department of Information Systems University of Maryland Baltimore County Baltimore, MD, US(信息系统系马里兰大学巴尔的摩县);Department of Mechanical Engineering Baylor University Waco,TX, US(机械工程系贝勒大学)
Neurosymbolic Retrievers for Retrieval-augmented Generation
Dept. of CSEE University of Maryland Baltimore County, Maryland, USA(电子工程系大学马里兰大学巴尔的摩县);Dept. of CSEE University of Maryland Baltimore County, MD, USA(电子工程系大学马里兰大学巴尔的摩县)
A neurosymbolic Approach with Epistemic Deep Learning for Hierarchical Image Classification
Institute for AI, Data Analysis and Systems (AIDAS) School of Engineering, Computing and Mathematics, Oxford Brookes University, UK(人工智能、数据分析和系统研究所(AIDAS)工程、计算与数学学院,英国奥克斯福德布鲁克斯大学)
Learning Interpretable Rules from Neural Networks: Neurosymbolic AI for Radar Hand Gesture Recognition
Technical University of Munich(慕尼黑技术大学);Infineon Technologies AG(英飞凌科技有限公司);Johannes Kepler University Linz(约翰·开普勒大学林茨分校);Software Competence Center Hagenberg GmbH (SCCH)(哈根贝格软件竞争力中心(SCCH))
Neurosymbolic Learning for Advanced Persistent Threat Detection under Extreme Class Imbalance
1 Center for Secure \& Intelligent Critical Systems;School of Cybersecurity, Old Dominion University, VA, USA;2 Department of Computer Engineering, University of Isfahan, Iran;3 Faculty of Engineering Modern Technologies, Amol University of Special Modern Technologies, Iran;4 Department of Electrical;Computer Engineering, Worcester Polytechnic Institute, MA, USA;5 Department of Electrical;Department of Computer Science Old Dominion University VA, USA;Department of Computer Engineering, University of Isfahan, Isfahan, Iran \& Center for Secure \& Intelligent Critical Systems, Old Dominion University, VA, USA;Faculty of Engineering Modern Technologies Amol University of Special Modern Technologies Amol, Iran;Department of Electrical;Computer Engineering Worcester Polytechnic Institute MA, USA;Center for Secure \& Intelligent Critical Systems Old Dominion University VA, USA;Bradley Department of Electrical \& Computer Engineering Virginia Tech, Arlington VA, USA