In the literature, a large body of work advocates the use of log-ratio transformation for multivariate statistical analysis of compositional data. In contrast, few studies have looked at how data transformation changes the efficacy of machine learning classifiers within geoscience. This letter presents experiment results and empirical observations to further explore this issue. The objective is to study the effects of data transformation on geozone classification performance when machine learning (ML) classifiers/estimators are trained using geochemical data. The training input consists of exploration hole assay samples obtained from a Pilbara iron-ore deposit in Western Australia, and geozone labels assigned based on stratigraphic units, the absence or presence and type of mineralization. The ML techniques considered are multinomial logistic regression, Gaussian naïve Bayes, kNN, linear support vector classifier, RBF-SVM, gradient boosting and extreme GB, random forest (RF) and multi-layer perceptron (MLP). The transformations examined include isometric log-ratio (ILR), center log-ratio (CLR) coupled with principal component analysis (PCA) or independent component analysis (ICA), and a manifold learning approach based on local linear embedding (LLE). The results reveal that different ML classifiers exhibit varying sensitivity to these transformations, with some clearly more advantageous or deleterious than others. Overall, the best performing candidate is ILR which is unsurprising considering the compositional nature of the data. The performance of pairwise log-ratio (PWLR) transformation is better than ILR for ensemble and tree-based learners such as boosting and RF; but worse for MLP, SVM and other classifiers.
Sparse-softmax: A Simpler and Faster Alternative Softmax Transformation
Cardiff University(卡迪夫大学);Osaka City University(大阪市立大学);Beijing Jiaotong University(北京交通大学);Shenzhen University(深圳大学);Shenzhen Zhuiyi Technology Co., Ltd.(深圳追一科技有限公司);Chinese Academy of Science(中国科学院)
Enhancing Transformation-based Defenses using a Distribution Classifier
National University of Singapore(新加坡国立大学);Bioinformatics Institute, A*STAR(新加坡科技研究局生物信息学研究所);CNRS UMI 2955(法国国家科学研究中心联合实验室2955);Singapore Eye Research Institute(新加坡眼科研究所)