arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.08795cs.LGcs.CEcs.HCstat.AP
收藏

结构工程数据可视化中t-SNE算法的实证评估

An Empirical Evaluation of the t-SNE Algorithm for Data Visualization in Structural Engineering

University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校);University of Colorado Boulder(科罗拉多大学博尔德分校)

Parisa Hajibabaee, Farhad Pourkamali-Anaraki, Mohammad Amin Hariri-Ardebili

摘要:

机器学习中的一个基本任务涉及可视化在高影响力应用领域中出现的高维数据集。当考虑到大量不平衡数据的背景时,这个问题变得更具挑战性。在本文中,t-分布随机邻居嵌入(t-SNE)算法被用来减少地震工程相关的数据集的可视化目的的维数。由于不平衡的数据集极大地影响了分类器的准确性,我们采用合成少数过采样技术(SMOTE)来解决这种数据集的不平衡性质。我们提出了从t-SNE和SMOTE得到的结果,并比较它的基本方法与各个方面。考虑到四个选项和六个分类算法,我们表明,使用t-SNE的不平衡数据和SMOTE的训练数据集,神经网络分类器有前途的结果,而不牺牲准确性。因此,我们可以将研究的科学数据转换为二维(2D)空间,从而使用2D图实现分类器和所得决策表面的可视化。

英文摘要:

A fundamental task in machine learning involves visualizing high-dimensional data sets that arise in high-impact application domains. When considering the context of large imbalanced data, this problem becomes much more challenging. In this paper, the t-Distributed Stochastic Neighbor Embedding (t-SNE) algorithm is used to reduce the dimensions of an earthquake engineering related data set for visualization purposes. Since imbalanced data sets greatly affect the accuracy of classifiers, we employ Synthetic Minority Oversampling Technique (SMOTE) to tackle the imbalanced nature of such data set. We present the result obtained from t-SNE and SMOTE and compare it to the basic approaches with various aspects. Considering four options and six classification algorithms, we show that using t-SNE on the imbalanced data and SMOTE on the training data set, neural network classifiers have promising results without sacrificing accuracy. Hence, we can transform the studied scientific data into a two-dimensional (2D) space, enabling the visualization of the classifier and the resulting decision surface using a 2D plot.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑