One Explanation Does Not Fit All: A Toolkit and Taxonomy of AI Explainability Techniques
IBM Research(IBM研究院)
Vijay Arya, Rachel K. E. Bellamy, Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C. Hoffman, Stephanie Houde, Q. Vera Liao, Ronny Luss, Aleksandra Mojsilovi… 展开作者
Vijay Arya, Rachel K. E. Bellamy, Pin-Yu Chen, Amit Dhurandhar, Michael Hind, Samuel C. Hoffman, Stephanie Houde, Q. Vera Liao, Ronny Luss, Aleksandra Mojsilović, Sami Mourad, Pablo Pedemonte, Ramya Raghavendra, John Richards, Prasanna Sattigeri, Karthikeyan Shanmugam, Moninder Singh, Kush R. Varshney, Dennis Wei, Yunfeng Zhang
As artificial intelligence and machine learning algorithms make further inroads into society, calls are increasing from multiple stakeholders for these algorithms to explain their outputs. At the same time, these stakeholders, whether they be affected citizens, government regulators, domain experts, or system developers, present different requirements for explanations. Toward addressing these needs, we introduce AI Explainability 360 (http://aix360.mybluemix.net/), an open-source software toolkit featuring eight diverse and state-of-the-art explainability methods and two evaluation metrics. Equally important, we provide a taxonomy to help entities requiring explanations to navigate the space of explanation methods, not only those in the toolkit but also in the broader literature on explainability. For data scientists and other users of the toolkit, we have implemented an extensible software architecture that organizes methods according to their place in the AI modeling pipeline. We also discuss enhancements to bring research innovations closer to consumers of explanations, ranging from simplified, more accessible versions of algorithms, to tutorials and an interactive web demo to introduce AI explainability to different audiences and application domains. Together, our toolkit and taxonomy can help identify gaps where more explainability methods are needed and provide a platform to incorporate them as they are developed.
随着人工智能和机器学习算法在社会上越来越普遍,多个利益相关者都在呼吁这些算法提供解释。同时,这些利益相关者,无论是受影响的公民,政府监管机构,领域专家还是系统开发人员,都有不同的解释需求。为了满足这些需求,我们于2019年创建了AI Explainability 360(Arya等人,2020),这是一个开源软件工具包,包含十种不同且最先进的可解释性方法和两个评估指标。本文通过几个案例研究、统计数据和社区反馈来研究该工具包的影响。用户体验AI Explainability 360的不同方式导致了多种类型的影响和多个指标的改进,独立的LF AI & Data Foundation采用该工具包突出了这一点。文件还介绍了该工具包的灵活设计、使用实例以及向用户提供的重要教育材料和文件。
Policy-Driven AI in Dataspaces: Taxonomy, Explainability, and Pathways for Compliant Innovation
Department of CST Tsinghua University Beijing, China(计算机科学与技术系 清华大学 北京中国);Department of CSE Chandigarh University Mohali, India(计算机科学与工程系 印度昌迪加尔大学 摩哈利)
Explainability for Large Language Models: A Survey
New Jersey Institute of Technology(新泽西理工学院);Johns Hopkins University(约翰斯·霍普金斯大学);Wake Forest University(维克森林大学);University of Georgia(佐治亚大学);Shanghai Jiao Tong University(上海交通大学);Institute of Computing Technology, CAS(中国科学院计算技术研究所);Baidu Inc.(百度公司);Rice University(莱斯大学)