arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2109.13610cs.LG
收藏

基于混淆的排名相似性过滤器,用于对高维数据进行计算高效的机器学习

Confusion-based rank similarity filters for computationally-efficient machine learning on high dimensional data

Frankfurt Institute for Advanced Studies(法兰克福高等研究所);Ernst Strüngmann Institute (ESI) for Neuroscience in cooperation with the Max Planck Society(恩斯特·施特龙曼神经科学研究所(与马克斯·普朗克学会合作));ICAR3R-Interdisciplinary Centre for 3Rs in Animal Research, Faculty of Medicine, Justus Liebig University(吉森大学医学院动物研究跨学科3Rs中心(ICAR3R))

Katharine A. Shapcott, Alex D. Bird

摘要:

我们介绍了一种新型的计算效率高的人工神经网络(ANN)称为秩相似过滤器(RSF)。RSF可以用于转换和分类具有许多数据点和维度的非线性可分离数据集。RSF的权重是使用数据点中特征的排序来设置的,或者可选地使用特征之间的“混淆”调整后的排序(根据特征在数据集中的分布来确定)。滤波器的激活强度决定了它与数据集中其他点的相似性,这是一个与余弦相似性相关的度量。许多RSF的激活将样本映射到适合线性分类的新的非线性空间(秩相似性变换(Rank Similarity Transform,RRM))。我们还使用这种方法来创建非线性秩相似性分类器(RSC),这是一种快速准确的多类分类器,以及非线性秩相似性概率分类器(RSPC),这是对多标签情况的扩展。我们在多个数据集上评估了分类器,RSC与现有的分类器相比具有竞争力,但具有更高的计算效率。开源代码的开发者,RSC和RSPC是用Python编写的,使用流行的scikit-learn框架,使其易于访问。在未来的扩展中,该算法可以应用于专用硬件,适用于ANN(GPU)和脉冲神经网络(类脑计算)的并行化,具有相应的性能增益。这使得RSF的一个有前途的解决方案的问题,有效的分析非线性可分离的数据。

英文摘要:

We introduce a novel type of computationally efficient artificial neural network (ANN) called the rank similarity filter (RSF). RSFs can be used to both transform and classify nonlinearly separable datasets with many data points and dimensions. The weights of RSF are set using the rank orders of features in a data point, or optionally the 'confusion' adjusted ranks between features (determined from their distributions in the dataset). The activation strength of a filter determines its similarity to other points in the dataset, a measure related to cosine similarity. The activation of many RSFs maps samples into a new nonlinear space suitable for linear classification (the rank similarity transform (RST)). We additionally used this method to create the nonlinear rank similarity classifier (RSC), which is a fast and accurate multiclass classifier, and the nonlinear rank similarity probabilistic classifier (RSPC), which is an extension to the multilabel case. We evaluated the classifiers on multiple datasets and RSC was competitive with existing classifiers but with superior computational efficiency. Open-source code for RST, RSC and RSPC was written in Python using the popular scikit-learn framework to make it easily accessible. In future extensions the algorithm can be applied to specialised hardware suitable for the parallelization of an ANN (GPU) and a Spiking Neural Network (neuromorphic computing) with corresponding performance gains. This makes RSF a promising solution to the problem of efficient analysis of nonlinearly separable data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑