首页/论文/2007.08986

arXiv 2007.089862020-07-17cs.LGstat.ML

Low-dimensional Interpretable Kernels with Conic Discriminant Functions for Classification

Eskişehir Teknik Üniversitesi（埃斯基谢希尔技术大学）；Erasmus University Rotterdam（鹿特丹伊拉斯姆斯大学）

Gurhan Ceylan, S. Ilker Birbil

英文摘要：

Kernels are often developed and used as implicit mapping functions that show impressive predictive power due to their high-dimensional feature space representations. In this study, we gradually construct a series of simple feature maps that lead to a collection of interpretable low-dimensional kernels. At each step, we keep the original features and make sure that the increase in the dimension of input data is extremely low, so that the resulting discriminant functions remain interpretable and amenable to fast training. Despite our persistence on interpretability, we obtain high accuracy results even without in-depth hyperparameter tuning. Comparison of our results against several well-known kernels on benchmark datasets show that the proposed kernels are competitive in terms of prediction accuracy, while the training times are significantly lower than those obtained with state-of-the-art kernel implementations.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

From Two-Class Linear Discriminant Analysis to Interpretable Multilayer Perceptron Design

University of Southern California（南加州大学）；Army Research Laboratory（陆军研究实验室）

A closed-form solution exists in two-class linear discriminant analysis (LDA), which discriminates two Gaussian-distributed classes in a multi-dimensional feature space. In this work, we interpret the multilayer perceptron (MLP) as a generalization of a two-class LDA system so that it can handle an input composed by multiple Gaussian modalities belonging to multiple classes. Besides input layer $l_{in}$ and output layer $l_{out}$, the MLP of interest consists of two intermediate layers, $l_1$ and $l_2$. We propose a feedforward design that has three stages: 1) from $l_{in}$ to $l_1$: half-spac…

2020-09-09cs.LGstat.ML

直接处理线性判别分析中的缺失数据以提升分类准确率与可解释性

Directly Handling Missing Data in Linear Discriminant Analysis for Enhancing Classification Accuracy and Interpretability

针对现实数据集存在缺失值影响LDA分类准确率与可解释性的问题，提出无需插补的WLDA方法，通过权重矩阵惩罚缺失条目直接优化参数估计，在多数据集上表现优于传统方法，兼顾性能与可解释性。

2024-10-09cs.LGstat.ML

Deep IDA: A Deep Learning Method for Integrative Discriminant Analysis of Multi-View Data with Feature Ranking -- An Application to COVID-19 severity

University of Minnesota（明尼苏达大学）

COVID-19 severity is due to complications from SARS-Cov-2 but the clinical course of the infection varies for individuals, emphasizing the need to better understand the disease at the molecular level. We use clinical and multiple molecular data (or views) obtained from patients with and without COVID-19 who were (or not) admitted to the intensive care unit to shed light on COVID-19 severity. Methods for jointly associating the views and separating the COVID-19 groups (i.e., one-step methods) have focused on linear relationships. The relationships between the views and COVID-19 patient groups, …

2021-11-24cs.LGstat.MEstat.ML

一种不确定性感知的贝叶斯机器学习分类模型框架：以土地覆盖分类为例

An uncertainty-aware Bayesian framework for machine learning classification models: A case study in land cover classification

National Physical Laboratory, Teddington, UK（英国国家物理实验室，Teddington）；Department of Data Science（数据科学系）；Department of Thermal & Radiometric Metrology（热学与辐射计量学系）；School of Geography, Geology & the Environment（地理、地质与环境学院）

提出一种考虑输入测量不确定性的贝叶斯生成式分类模型框架，通过贝叶斯二次判别分析模型在土地覆盖数据集上验证，该模型在可解释性、不确定性建模和计算效率方面优于随机森林和神经网络。

2026-05-26cs.CVcs.LGstat.ML

逻辑回归的代价敏感最优子集选择：混合整数锥优化视角

Cost-Sensitive Best Subset Selection for Logistic Regression: A Mixed-Integer Conic Optimization Perspective

University of Applied Sciences Berlin（柏林应用科学大学）

针对机器学习尤其是临床领域可解释模型的特征选择需求，提出一种考虑特征获取代价的混合整数锥优化逻辑回归最优特征选择方法，构建合成数据集生成器评估发现现有方法在小数据和标签噪声下有局限，给出实证建议并为元学习研究铺路。

2023-10-09cs.AIcs.LG

多变量函数线性判别分析用于缺失数据的短时间序列分类

Multivariate Functional Linear Discriminant Analysis for the Classification of Short Time Series with Missing Data

Institute of Computer Science, University of Rostock, Germany（罗斯托克大学计算机科学研究所）；Indian Institute of Science Education and Research, Thiruvananthapuram（泰尔胡瓦纳纳特帕拉姆印度科学教育与研究学院）；Leibniz–Institute for Food Systems Biology, Technical University of Munich, Freising, Germany（莱比锡食品系统生物学研究所，慕尼黑技术大学，弗莱辛，德国）；Stellenbosch Institute of Advanced Studies (STIAS), South Africa（斯坦伦博斯高级研究 institute（STIAS），南非）

本文提出MUDRA方法，通过高效ECM算法处理多变量时间序列中的缺失数据，提升分类性能，尤其在缺失数据情况下表现更优。

2024-02-20cs.LGmath.STstat.TH

更多相关论文收起更多论文

一种基于核的模块化判别分析框架用于小样本学习

Structure and Regularization of Fused Objectives in Kernel Discriminant Analysis for Small-Sample-Size Problems

University of Aizu（会津大学）

本文系统研究了核化线性主成分判别分析（KLPCDA）框架，通过跨领域实验和消融分析揭示其方差、类间和类内目标的交互机制，并提供了变体选择指南，证明其在多种小样本任务中性能稳健且计算高效。

2026-10-28cs.LG

Effects of Parametric and Non-Parametric Methods on High Dimensional Sparse Matrix Representations

Vidyalankar Institute of Technology（维迪亚兰卡尔理工学院）；University of Mumbai（孟买大学）

The semantics are derived from textual data that provide representations for Machine Learning algorithms. These representations are interpretable form of high dimensional sparse matrix that are given as an input to the machine learning algorithms. Since learning methods are broadly classified as parametric and non-parametric learning methods, in this paper we provide the effects of these type of algorithms on the high dimensional sparse matrix representations. In order to derive the representations from the text data, we have considered TF-IDF representation with valid reason in the paper. We …

2022-02-07cs.LG

基于模拟退火的优化特征子集选择

Optimised Feature Subset Selection via Simulated Annealing

Instituto de Física Fundamental, IFF-CSIC（物理基础研究所，IFF-CSIC）；Inspiration-Q

本研究提出基于模拟退火的ℓ₀范数特征选择算法SA-FDR，以费希尔判别比为优化导向做全局搜索，能捕捉特征间依赖，在高维数据上可在保证准确率的同时选出更紧凑的特征子集，助力可解释模型设计。

2025-07-31cond-mat.stat-mechcs.LGstat.ML

PixelHop++: A Small Successive-Subspace-Learning-Based (SSL-based) Model for Image Classification

University of Southern California（南加州大学）；Army Research Laboratory（陆军研究实验室）

The successive subspace learning (SSL) principle was developed and used to design an interpretable learning model, known as the PixelHop method,for image classification in our prior work. Here, we propose an improved PixelHop method and call it PixelHop++. First, to make the PixelHop model size smaller, we decouple a joint spatial-spectral input tensor to multiple spatial tensors (one for each spectral component) under the spatial-spectral separability assumption and perform the Saab transform in a channel-wise manner, called the channel-wise (c/w) Saab transform.Second, by performing this ope…

2020-02-08cs.LGeess.IVstat.ML

Conditional Bures Metric for Domain Adaptation

Pazhou Lab（琶洲实验室）

As a vital problem in classification-oriented transfer, unsupervised domain adaptation (UDA) has attracted widespread attention in recent years. Previous UDA methods assume the marginal distributions of different domains are shifted while ignoring the discriminant information in the label distributions. This leads to classification performance degeneration in real applications. In this work, we focus on the conditional distribution shift problem which is of great concern to current conditional invariant models. We aim to seek a kernel covariance embedding for conditional distribution which rem…

2021-07-31cs.CVcs.LG

解释基于GNN的入侵检测系统检测结果：利用溯源图结构特征

Interpreting GNN-based IDS Detections Using Provenance Graph Structural Features

Virginia Tech（弗吉尼亚理工大学）；The University of Texas at Dallas（德克萨斯大学达拉斯分校）

针对基于GNN的入侵检测系统缺乏可解释性的问题，提出PROVEXPLAINER框架，利用可解释代理模型结合判别子图模式和结构特征，在真实数据集上相比SOTA解释器显著提升解释质量与可操作性。

2025-10-09cs.CRcs.LG

多分类器比较用于Android恶意软件检测：侧重于特征洞察使用CICMalDroid 2020数据集

Comparison of Multiple Classifiers for Android Malware Detection with Emphasis on Feature Insights Using CICMalDroid 2020 Dataset

Department of Biosystems Engineering, Auburn University（生物系统工程系，阿伯拉罕大学）；Independent Researcher（独立研究员）

本文比较了多个分类器在Android恶意软件检测中的性能，发现基于原始特征的梯度提升在准确率、精确率、召回率和F1值上表现最佳，同时揭示了关键驱动因素。

2026-01-20cs.CRcs.LG