In this paper, we focus on the problem of identifying semantic factors of variation in large image datasets. By training a convolutional Autoencoder on the image data, we create encodings, which describe each datapoint at a higher level of abstraction than pixel-space. We then apply Principal Component Analysis to the encodings to disentangle the factors of variation in the data. Sorting the dataset according to the values of individual principal components, we find that samples at the high and low ends of the distribution often share specific semantic characteristics. We refer to these groups of samples as semantic groups. When applied to real-world data, this method can help discover unwanted edge-cases.
Contrastive Training of Complex-Valued Autoencoders for Object Discovery
The Swiss AI Lab, IDSIA, USI & SUPSI(瑞士AI实验室,IDSIA,USI与SUPSI);Center for Brain Science, Harvard University(哈佛大学脑科学中心);AI Initiative, KAUST(阿卜杜拉国王科技大学AI计划)
Boarding for ISS: Imbalanced Self-Supervised: Discovery of a Scaled Autoencoder for Mixed Tabular Datasets
Université Claude Bernard Lyon 1(里昂第一大学);Aix Marseille Université(艾克斯-马赛大学);CNRS(法国国家科学研究中心);Centrale Marseille(马赛中央理工学院);I2M(数学与力学研究所);Université du Québec à Montréal(蒙特利尔大学)
Imperial College London(帝国理工学院);Jean le Rond d’Alembert Institute(让·勒朗·达朗贝尔研究所);CNRS(法国国家科学研究中心);Sorbonne University(索邦大学);ONERA(法国国家航空航天研究院);Université Paris Saclay(巴黎萨克雷大学)
SplInterp: Improving our Understanding and Training of Sparse Autoencoders
School of Mathematics University of Birmingham(数学学院英国伯明翰大学);Ideami Studios(Ideami工作室);Department of Mathematics and Statistics University of Limerick(数学与统计学学院英国利默里克大学);XRAI Inc.(XRAI公司);Department of Computer Science Brown University(计算机科学系布朗大学)