arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2004.06149cs.LGstat.ML
收藏

局部模型特征变换

Local Model Feature Transformations

The University of South Alabama(南阿拉巴马大学)

CScott Brown

摘要:

局部学习方法是一类流行的机器学习算法。整个干部的基本思想是选择一些非本地模型族,在相邻数据的小部分上训练它们中的许多,然后以某种方式将结果模型“缝合”在一起。由于将训练数据集约束到一个小邻域的限制,对局部学习模型的研究在很大程度上限于简单的模型族。此外,由于简单的模型族在设计上没有复杂的结构,这限制了单个局部模型对预测任务的使用。我们假设,使用足够复杂的局部模型族,各个局部模型的各种属性,例如它们的学习参数,可以用作进一步学习的特征。本文改进了目前的研究状况,并致力于建立这一假设,调查算法的本地化更复杂的模型家庭,并通过研究其应用超出预测作为一个特征提取机制。我们总结了这种通用的技术,使用本地模型作为特征提取步骤与术语“本地模型特征转换。在本文中,我们将局部建模范式扩展到高斯过程、正交二次模型和词嵌入模型,并扩展了局部线性分类器的现有理论。然后,我们展示了局部模型特征变换的应用程序,癫痫事件分类从EEG读数,活动监测通过胸部加速度计,3D表面重建,3D点云分割,手写数字分类和事件检测从Twitter的饲料。

英文摘要:

Local learning methods are a popular class of machine learning algorithms. The basic idea for the entire cadre is to choose some non-local model family, to train many of them on small sections of neighboring data, and then to `stitch' the resulting models together in some way. Due to the limits of constraining a training dataset to a small neighborhood, research on locally-learned models has largely been restricted to simple model families. Also, since simple model families have no complex structure by design, this has limited use of the individual local models to predictive tasks. We hypothesize that, using a sufficiently complex local model family, various properties of the individual local models, such as their learned parameters, can be used as features for further learning. This dissertation improves upon the current state of research and works toward establishing this hypothesis by investigating algorithms for localization of more complex model families and by studying their applications beyond predictions as a feature extraction mechanism. We summarize this generic technique of using local models as a feature extraction step with the term ``local model feature transformations.'' In this document, we extend the local modeling paradigm to Gaussian processes, orthogonal quadric models and word embedding models, and extend the existing theory for localized linear classifiers. We then demonstrate applications of local model feature transformations to epileptic event classification from EEG readings, activity monitoring via chest accelerometry, 3D surface reconstruction, 3D point cloud segmentation, handwritten digit classification and event detection from Twitter feeds.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑