In the last decade neural network have made huge impact both in industry and research due to their ability to extract meaningful features from imprecise or complex data, and by achieving super human performance in several domains. However, due to the lack of transparency the use of these networks is hampered in the areas with safety critical areas. In safety-critical areas, this is necessary by law. Recently several methods have been proposed to uncover this black box by providing interpreation of predictions made by these models. The paper focuses on time series analysis and benchmark several state-of-the-art attribution methods which compute explanations for convolutional classifiers. The presented experiments involve gradient-based and perturbation-based attribution methods. A detailed analysis shows that perturbation-based approaches are superior concerning the Sensitivity and occlusion game. These methods tend to produce explanations with higher continuity. Contrarily, the gradient-based techniques are superb in runtime and Infidelity. In addition, a validation the dependence of the methods on the trained model, feasible application domains, and individual characteristics is attached. The findings accentuate that choosing the best-suited attribution method is strongly correlated with the desired use case. Neither category of attribution methods nor a single approach has shown outstanding performance across all aspects.
Comprehensive and Reliable Feature Attribution for Diverse Modalities and Models via Frequency-Domain Insights
School of Computational Science, Wuhan University(武汉大学计算科学学院);Brain Research Center, Wuhan University(武汉大学脑科学研究中心);College of Information Science and Technology (School of Cyber Science and Technology), Shihezi University(石河子大学信息科学学院(网络安全科学与技术学院));Xinjiang Production and Construction Corps Key Laboratory of Computing Intelligence and Network Information Security Open Fund(新疆生产建设兵团计算智能与网络信息安全重点实验室开放基金)
Neural Codec Source Tracing: Toward Comprehensive Attribution in Open-Set Condition
Communication University of China(中国传媒大学);University of Chinese Academy of Sciences(中国科学院大学);Chinese Academy of Sciences(中国科学院);Tsinghua University(清华大学);Tencent(腾讯)
StanceFlip: A Comprehensive Multi-Dimensional Benchmark for Multimodal Conversational Stance Flipping Forecasting
College of Computer Science and Software Engineering, Shenzhen University(深圳大学计算机科学与软件学院);Harbin Institute of Technology Shenzhen(哈尔滨工业大学(深圳));City University of Macau(澳门城市大学)
MAC: A Conversion Rate Prediction Benchmark Featuring Labels Under Multiple Attribution Mechanisms
.1em blue n Nanjing University, Nanjing, China .1em purple a Taobao \& Tmall Group of Alibaba, Beijing, China;.1em blue n Nanjing University, Nanjing, China;.1em purple a Taobao \& Tmall Group of Alibaba, Beijing, China
Audio Deepfake Attribution: An Initial Dataset and Investigation
School of Electronics and Information Engineering, Beihang University(北京航空航天大学电子信息工程学院);Tsinghua University(清华大学);National Research Center for Information Science and Technology, Tsinghua University(清华大学国家信息科学与技术研究中心)
Generating Attribution Reports for Manipulated Facial Images: A Dataset and Baseline
Xi’an Jiaotong University(西安交通大学);Hefei University of Technology(合肥工业大学);CSIRO(澳大利亚联邦科学与工业研究组织);Northwestern Polytechnical University(西北工业大学);University of Macau(澳门大学)
An Empirical Evaluation of Factors Affecting SHAP Explanation of Time Series Classification
School of Engineering Mathematics and Technology, University of Bristol, UK(工程数学与技术学院,布里斯托大学);School of Computer Science, University College Dublin, Ireland(计算机科学学院,都柏林大学学院)
A Comprehensive Benchmark for Electrocardiogram Time-Series
Hangzhou Institute for Advanced Study, University of Chinese Academy of Sciences(中国科学院大学杭州先进研究所);Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心)
Why Do Class-Dependent Evaluation Effects Occur with Time Series Feature Attributions? A Synthetic Data Investigation
Information Systems, Eindhoven University of Technology, Eindhoven, The Netherlands(信息系统,埃因霍温理工大学,埃因霍温,荷兰);Eindhoven Artificial Intelligence Systems Institute, Eindhoven University of Technology, Eindhoven, The Netherlands(埃因霍温人工智能系统研究所,埃因霍温理工大学,埃因霍温,荷兰);Human-Technology Interaction, Eindhoven University of Technology, Eindhoven, The Netherlands(人机交互,埃因霍温理工大学,埃因霍温,荷兰)
Explaining Time Series Classifiers with PHAR: Rule Extraction and Fusion from Post-hoc Attributions
Jagiellonian Human-Centered AI Lab, Mark Kac Center for Complex Systems Research(杰克利昂人类中心人工智能实验室、马克·卡复杂系统研究中心);Institute of Applied Computer Science, Jagiellonian University(应用计算机科学研究所、杰克利昂大学)
FreqLens: Interpretable Frequency Attribution for Time Series Forecasting
Independent Researcher(独立研究者);Indiana University at Bloomington(印第安纳大学布卢明顿分校);National Yang Ming Chiao Tung University;National Taiwan University(国立台湾大学);Boise State University(博伊州立大学)
Class-Dependent Perturbation Effects in Evaluating Time Series Attributions
Information Systems, Eindhoven University of Technology, Eindhoven, The Netherlands Eindhoven Artificial Intelligence Systems Institute, Eindhoven University of Technology, Eindhoven, The Netherlands Human-Technology Interaction, Eindhoven University of Technology, Eindhoven, The Netherlands
Towards A Unified Information Bottleneck Framework for Time Series Explanations
Florida International University(佛罗里达国际大学);Carnegie Mellon University(卡内基梅隆大学);University of Houston(休斯顿大学);NEC Labs America(美国 NEC 实验室);Singapore Management University(新加坡管理大学)
Attribution Explanations for Deep Neural Networks: A Theoretical Perspective
School of Computer Science and Technology, Xi’an Jiaotong University(西安交通大学计算机科学与技术学院);School of Cyber Science and Engineering, Xi’an Jiaotong University(西安交通大学网络安全工程学院);Department of Computer Science and Engineering, the John Hopcroft Center, Shanghai Jiao Tong University(上海交通大学计算机科学与工程系、霍夫曼中心);Department of Data Science, New Jersey Institute of Technology(新泽西理工学院数据科学系)