习得表征尊重因果关系吗?
Do learned representations respect causal relationships?
摘要:
数据通常有许多语义属性,这些属性之间存在因果关系。但是,数据的特定属性习得表征也尊重同样的因果关系吗?我们分三步回答这个问题。首先,我们介绍NCINet,一种从高维数据中发现观测因果关系的方法。它完全基于合成生成的表示进行训练,可以应用于真实表示,并且专门设计用于缓解两者之间的域差距。其次,我们应用NCINet来识别不同属性对的图像表示之间的因果关系,标签之间具有已知和未知的因果关系。为此,我们考虑学习图像表示来预测3D ESTA,CelebA和CASIA-WebFace数据集上的属性,我们用多个多类属性进行注释。第三,我们分析了在表示学习中,不同的设计选择对所学习表征之间潜在因果关系的影响。我们的实验表明,(1)NCINet在估计随机样本对之间的因果关系方面明显优于现有的观察因果发现方法,无论是在存在还是不存在未观察到的混淆因素的情况下,(2)在受控场景下,学习表示确实可以满足其各自标签之间的潜在因果关系,因果关系与表征的预测能力呈正相关。
英文摘要:
Data often has many semantic attributes that are causally associated with each other. But do attribute-specific learned representations of data also respect the same causal relations? We answer this question in three steps. First, we introduce NCINet, an approach for observational causal discovery from high-dimensional data. It is trained purely on synthetically generated representations and can be applied to real representations, and is specifically designed to mitigate the domain gap between the two. Second, we apply NCINet to identify the causal relations between image representations of different pairs of attributes with known and unknown causal relations between the labels. For this purpose, we consider image representations learned for predicting attributes on the 3D Shapes, CelebA, and the CASIA-WebFace datasets, which we annotate with multiple multi-class attributes. Third, we analyze the effect on the underlying causal relation between learned representations induced by various design choices in representation learning. Our experiments indicate that (1) NCINet significantly outperforms existing observational causal discovery approaches for estimating the causal relation between pairs of random samples, both in the presence and absence of an unobserved confounder, (2) under controlled scenarios, learned representations can indeed satisfy the underlying causal relations between their respective labels, and (3) the causal relations are positively correlated with the predictive capability of the representations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。