The increasing complexity of LLMs presents significant challenges to their transparency and interpretability, necessitating the use of eXplainable AI (XAI) techniques to enhance trustworthiness and usability. This study introduces a comprehensive evaluation framework with four novel metrics for assessing the effectiveness of five XAI techniques across five LLMs and two downstream tasks. We apply this framework to evaluate several XAI techniques LIME, SHAP, Integrated Gradients, Layer-wise Relevance Propagation (LRP), and Attention Mechanism Visualization (AMV) using the IMDB Movie Reviews and Tweet Sentiment Extraction datasets. The evaluation focuses on four key metrics: Human-reasoning Agreement (HA), Robustness, Consistency, and Contrastivity. Our results show that LIME consistently achieves high scores across multiple LLMs and evaluation metrics, while AMV demonstrates superior Robustness and near-perfect Consistency. LRP excels in Contrastivity, particularly with more complex models. Our findings provide valuable insights into the strengths and limitations of different XAI methods, offering guidance for developing and selecting appropriate XAI techniques for LLMs.
Usable XAI: 10 Strategies Towards Exploiting Explainability in the LLM Era
University of Georgia(佐治亚大学);New Jersey Institute of Technology(新泽西理工学院);University of Virginia(弗吉尼亚大学);Wake Forest University(威克森林大学);King Abdullah University of Science and Technology(国王阿卜杜勒阿齐兹大学);Amazon(亚马逊)
TT-XAI: Trustworthy Clinical Text Explanations via Keyword Distillation and LLM Reasoning
Faculty of Computer and Information Science, University of Ljubljana, Slovenia(卢布尔雅那大学计算机与信息科学学院);ICAM - Advanced Environmental Research Institute, West University of Timisoara, Romania(蒂米șoara西大学先进环境研究所);Department of Computer Science, West University of Timisoara, Romania(蒂米șoa拉西大学计算机科学系)
Bridging LLMs and Symbolic Reasoning in Educational QA Systems: Insights from the XAI Challenge at IJCNN 2025
URA Research Group, Ho Chi Minh City University of Technology (HCMUT), Vietnam;Ho Chi Minh City International University (HCMIU), Vietnam;University of South-Eastern Norway, Norway;Japan Advanced Institute of Science;Univ. Bordeaux, CNRS, Bordeaux INP, LaBRI, UMR 5800, F-33400 Talence, France;University of Naples Parthenope, Italy;VNU Information Technology Institute, Vietnam National University, Vietnam;Visual Intelligence Lab, School of Computer Science \& Insight Center for Data Analyitcs, University of Galway, Ireland;Sapienza University of Rome, Italy
XAI-Grounded Explanation Generation for Speech Deepfake Detection with Training-Free Multimodal Large Language Models
Imperial College London(帝国理工学院);Technical University of Munich(慕尼黑工业大学);University of Southampton(南安普顿大学);MBZUAI(穆罕默德·本·扎耶德人工智能大学);Johns Hopkins University(约翰霍普金斯大学)
A Two-Stage LLM Framework for Accessible and Verified XAI Explanations
Department of Computer Engineering and Informatics, University of Patras(帕特拉大学计算机工程与信息学系);Department of Informatics and Telecommunications, University of Ioannina(伊奥安尼纳大学信息与电信系);Industrial Systems Institute, Athena Research Center(雅典研究中心工业系统研究所);Archimedes Unit, Athena Research Center(雅典研究中心阿基米德单位)
Multilingual Datasets for Custom Input Extraction and Explanation Requests Parsing in Conversational XAI Systems
Technische Universität Berlin(技术大学柏林);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);Saarland Informatics Campus(萨尔州信息学校区);Centre for European Research in Trusted AI (CERTAIN)(可信人工智能欧洲研究中心);BIFOLD – Berlin Institute for the Foundations of Learning and Data(柏林学习与数据基础研究院)
A Close Look at Decomposition-based XAI-Methods for Transformer Language Models
Fraunhofer Heinrich Hertz Institute(弗劳恩霍夫海因里希·赫兹研究所);BIFOLD - Berlin Institute for the Foundations of Learning and Data(BIFOLD——柏林学习与数据基础研究所);Technische Universität Berlin(柏林工业大学)
A word association network methodology for evaluating implicit biases in LLMs compared to humans
University of Pisa, Department of Computer Science(比萨大学计算机科学系);National Research Council of Italy, Institute of Information Science and Technologies(意大利国家研究委员会信息科学与技术研究所);University of Trento, Department of Psychology and Cognitive Science(特伦托大学心理学与认知科学系)
EmotionQueen: A Benchmark for Evaluating Empathy of Large Language Models
Fudan University(复旦大学);School of Computer Science, Fudan University(复旦大学计算机科学学院);Beijing Yuandian Technology(北京原点科技);School of Engineering and Applied Science, University of Pennsylvania(宾夕法尼亚大学工程与应用科学学院)
InMind: Evaluating LLMs in Capturing and Applying Individual Human Reasoning Styles
Nankai University(南开大学);Shanghai Innovation Institute(上海创新研究院);Shanghai AI Laboratory(上海人工智能实验室);Fudan University(复旦大学);Johns Hopkins University(约翰霍普金斯大学);Wuhan University(武汉大学);University of Science and Technology of China(中国科学技术大学)