单边分类工具包及其在光谱数据分析中的应用
A One-Sided Classification Toolkit with Applications in the Analysis of Spectroscopy Data
摘要:
本文研究了基于拉曼光谱的单边分类算法在危险氯化溶剂分离中的应用。实验是使用一个新的单边分类工具包进行的,该工具包是从头开始设计和开发的。在单侧分类范例中,目标是将目标类的元素与所有离群值分开。在实践中,当训练样本中存在某种缺陷时,通常会选择这些单侧分类器。有时候,异常的例子可能很罕见,标签昂贵,甚至完全不存在。然而,作者想指出的是,当异常值示例丰富但在统计上不能代表完整的异常值概念时,它们同样适用。正是这种情况下,是明确处理在这项研究工作。在这些情况下,已经发现单侧分类器比传统的多类分类器更鲁棒。引入术语“意外”离群值来表示测试集中遇到的离群值示例,这些离群值示例取自与训练集示例不同的分布。这些例子是由于训练集中所有可能的离群值的代表性不足而导致的。通常不可能完全排除异常值的例子,因为它们可以代表不可估量数量的“其他一切”,而不是目标。研究结果表明,当测试数据来自与训练样本完全不同的分布时,使用传统的多类分类算法存在潜在的缺陷。
英文摘要:
This dissertation investigates the use of one-sided classification algorithms in the application of separating hazardous chlorinated solvents from other materials, based on their Raman spectra. The experimentation is carried out using a new one-sided classification toolkit that was designed and developed from the ground up. In the one-sided classification paradigm, the objective is to separate elements of the target class from all outliers. These one-sided classifiers are generally chosen, in practice, when there is a deficiency of some sort in the training examples. Sometimes outlier examples can be rare, expensive to label, or even entirely absent. However, this author would like to note that they can be equally applicable when outlier examples are plentiful but nonetheless not statistically representative of the complete outlier concept. It is this scenario that is explicitly dealt with in this research work. In these circumstances, one-sided classifiers have been found to be more robust that conventional multi-class classifiers. The term "unexpected" outliers is introduced to represent outlier examples, encountered in the test set, that have been taken from a different distribution to the training set examples. These are examples that are a result of an inadequate representation of all possible outliers in the training set. It can often be impossible to fully characterise outlier examples given the fact that they can represent the immeasurable quantity of "everything else" that is not a target. The findings from this research have shown the potential drawbacks of using conventional multi-class classification algorithms when the test data come from a completely different distribution to that of the training samples.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。