Diffusion models have become increasingly popular for synthesizing high-quality samples based on training datasets. However, given the oftentimes enormous sizes of the training datasets, it is difficult to assess how training data impact the samples produced by a trained diffusion model. The difficulty of relating diffusion model inputs and outputs poses significant challenges to model explainability and training data attribution. Here we propose a novel solution that reveals how training data influence the output of diffusion models through the use of ensembles. In our approach individual models in an encoded ensemble are trained on carefully engineered splits of the overall training data to permit the identification of influential training examples. The resulting model ensembles enable efficient ablation of training data influence, allowing us to assess the impact of training data on model outputs. We demonstrate the viability of these ensembles as generative models and the validity of our approach to assessing influence.
GUDA: Counterfactual Group-wise Training Data Attribution for Diffusion Models via Unlearning
University of Tokyo(东京大学);Toyota Central Research Laboratory(丰田中央研究所);University of California, Berkeley(加州大学伯克利分校);Massachusetts Institute of Technology(麻省理工学院);National Institute of Advanced Industrial Science and Technology(国家工业科学与技术研究院)
Distributional Training Data Attribution: What do Influence Functions Sample?
University of Cambridge(剑桥大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Bristol(布里斯托大学);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);University of Toronto(多伦多大学);Vector Institute(向量研究所);Alan Turing Institute(艾伦·图灵研究所)
College of Engineering and Computer Science, VinUniversity(VinUniversity工程与计算机科学学院);VinUni-Illinois Smart Health Center, VinUniversity(VinUniversity伊利诺伊智能健康中心)
Tracing Generated Samples to Training-Data Clusters in Flow-Matching Models
Forschungszentrum Jülich(于利希研究中心);Technical University Dortmund(多特蒙德工业大学);Reichman University(赖希曼大学);Lamarr Institute(拉马尔研究所);Institute for AI in Medicine, University Hospital Essen(埃森大学医院医学人工智能研究所);Helmholtz AI(亥姆霍兹人工智能);University of Cologne(科隆大学)
Better Training Data Attribution via Better Inverse Hessian-Vector Products
University of Toronto(多伦多大学);Vector Institute for Artificial Intelligence(人工智能矢量研究所);Tübingen AI Center, University of Tübingen(图宾根大学人工智能中心);Schwartz Reisman Institute for Technology and Society(技术与社会施瓦茨-雷曼研究所)