Large Vision Language Models (LVLMs) have demonstrated remarkable reasoning capabilities over textual and visual inputs. However, these models remain prone to generating misinformation. Identifying and mitigating ungrounded responses is crucial for developing trustworthy AI. Traditional explainability methods such as gradient-based relevancy maps, offer insight into the decision process of models, but are often computationally expensive and unsuitable for real-time output validation. In this work, we introduce FastRM, an efficient method for predicting explainable Relevancy Maps of LVLMs. Furthermore, FastRM provides both quantitative and qualitative assessment of model confidence. Experimental results demonstrate that FastRM achieves a 99.8% reduction in computation time and a 44.4% reduction in memory footprint compared to traditional relevancy map generation. FastRM allows explainable AI to be more practical and scalable, thereby promoting its deployment in real-world applications and enabling users to more effectively evaluate the reliability of model outputs.
EX-FEVER: A Dataset for Multi-hop Explainable Fact Verification
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);ByteDance Inc.(字节跳动公司)
A Holistic Approach to Unifying Automatic Concept Extraction and Concept Importance Estimation
Carney Institute for Brain Science, Brown University(布朗大学卡尼脑科学研究所);Artificial and Natural Intelligence Toulouse Institute(图卢兹人工与自然智能研究所);Department of Computer Science, University of Maryland(马里兰大学计算机科学系)
Alert-ME: An Explainability-Driven Defense Against Adversarial Examples in Transformer-Based Text Classification
School of Computer Science, The University of Adelaide(阿德莱德大学计算机科学学院);CREST - The Centre for Research on Engineering Software Technologies(工程软件技术研究中心);Department of Computer Science and Software Engineering, The University of Western Australia(西澳大学计算机科学与软件工程学院)