Local learning methods are a popular class of machine learning algorithms. The basic idea for the entire cadre is to choose some non-local model family, to train many of them on small sections of neighboring data, and then to `stitch' the resulting models together in some way. Due to the limits of constraining a training dataset to a small neighborhood, research on locally-learned models has largely been restricted to simple model families. Also, since simple model families have no complex structure by design, this has limited use of the individual local models to predictive tasks. We hypothesize that, using a sufficiently complex local model family, various properties of the individual local models, such as their learned parameters, can be used as features for further learning. This dissertation improves upon the current state of research and works toward establishing this hypothesis by investigating algorithms for localization of more complex model families and by studying their applications beyond predictions as a feature extraction mechanism. We summarize this generic technique of using local models as a feature extraction step with the term ``local model feature transformations.'' In this document, we extend the local modeling paradigm to Gaussian processes, orthogonal quadric models and word embedding models, and extend the existing theory for localized linear classifiers. We then demonstrate applications of local model feature transformations to epileptic event classification from EEG readings, activity monitoring via chest accelerometry, 3D surface reconstruction, 3D point cloud segmentation, handwritten digit classification and event detection from Twitter feeds.
Improving classification performance by feature space transformations and model selection
INFOTEC Centro de Investigación e Innovación en Tecnologías de la Información y Comunicación(INFOTEC信息与通信技术研究与创新中心);Universidad Michoacana de San Nicolás de Hidalgo(米却肯州圣尼古拉斯·伊达尔戈大学);CONACyT Consejo Nacional de Ciencia y Tecnología(国家科学技术委员会)
Unsupervised Generative Feature Transformation via Graph Contrastive Pre-training and Multi-objective Fine-tuning
Arizona State University(亚利桑那州立大学);University of Kansas(堪萨斯大学);Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);IBM T. J. Watson Research Center(IBM T. J. 沃森研究中心)
Traceable Automatic Feature Transformation via Cascading Actor-Critic Agents
Computer Network Information Center, CAS(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);University of Central Florida(中佛罗里达大学);Institute for Infocomm Research, A*STAR(新加坡科技研究局资讯通信研究院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Portland State University(波特兰州立大学)
Collaborative Multi-Agent Reinforcement Learning for Automated Feature Transformation with Graph-Driven Path Optimization
Computer Network Information Center, Chinese Academy of Sciences, and the University of the Chinese Academy of Sciences(中国科学院计算机网络信息中心及中国科学院大学);Department of Electrical Engineering and Computer Science at the University of Kansas(堪萨斯大学电气工程与计算机科学系);School of Computing and Information Technology, Great Bay University, Dongguan, China(广东大湾大学计算机与信息科技学院);School of Software, Tsinghua University(清华大学软件学院);Institute for Infocomm Research, Agency for Science, Technology, and Research(新加坡科技研究局信息与通信研究院)
Enhancing Tabular Data Optimization with a Flexible Graph-based Reinforced Exploration Strategy
CNIC, CAS(中国科学院计算机网络信息中心);University of CAS(中国科学院大学);University of Kansas(堪萨斯大学);Great Bay University(大湾区大学);IR A*STAR(新加坡科技研究局智能研究院);Tsinghua University(清华大学)
Hierarchical and Permutation-Invariant Feature Transformation Learning via Policy-Guided Embedding Search
University of Kansas(堪萨斯大学);Southwest University of Finance and Economics(西南财经大学);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);University of Auckland(奥克兰大学);Arizona State University(亚利桑那州立大学);Northeast Normal University(东北师范大学)
Adaptive Law-Based Transformation (ALT): A Lightweight Feature Representation for Time Series Classification
Department of Computational Sciences, Wigner Research Centre for Physics(计算科学系,韦金科研物理中心);Department of Statistics, Corvinus University of Budapest(统计系,布达佩斯科文纽斯大学);Faculty of Science, Eötvös Loránd University(科学学院,欧文·洛朗大学);Faculty of Engineering and Natural Sciences, Tampere University(工程与自然科学学院,塔尔皮埃大学)
Detecting Anomalies within Time Series using Local Neural Transformations
University of Stuttgart(斯图加特大学);Bosch Center for Artificial Intelligence(博世人工智能中心);TU Kaiserslautern(凯泽斯劳滕工业大学);University of Southampton(南安普顿大学);UC Irvine(加州大学欧文分校)
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);University of Central Florida(中佛罗里达大学);Portland State University(波特兰州立大学);Institute for Infocomm Research(资讯通信研究院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))
FastFT: Accelerating Reinforced Feature Transformation via Advanced Exploration Strategies
Computer Network Information Center, Chinese Academy of Sciences(中国科学院计算机网络信息中心);University of Chinese Academy of Sciences(中国科学院大学);School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉科学学院);School of Computing and Information Technology, Great Bay University(大湾区大学计算与信息技术学院);Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局);Arizona State University(亚利桑那州立大学)
Neurochaos Feature Transformation and Classification for Imbalanced Learning
BMS Institute of Technology and Management(BMS理工与管理学院);National Institute of Advanced Studies(国家高等研究院);The University of Trans-Disciplinary Health Sciences And Technology(跨学科健康科学与技术大学)