首页/论文/1105.0972

arXiv 1105.09722011-05-05cs.LGcs.AIstat.ML

Rapid Feature Learning with Stacked Linear Denoisers

Washington University in St. Louis（圣路易斯华盛顿大学）；University of Southern California（南加州大学）

Zhixiang Eddie Xu, Kilian Q. Weinberger, Fei Sha

备注：: 10 pages

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

We investigate unsupervised pre-training of deep architectures as feature generators for "shallow" classifiers. Stacked Denoising Autoencoders (SdA), when used as feature pre-processing tools for SVM classification, can lead to significant improvements in accuracy - however, at the price of a substantial increase in computational cost. In this paper we create a simple algorithm which mimics the layer by layer training of SdAs. However, in contrast to SdAs, our algorithm requires no training through gradient descent as the parameters can be computed in closed-form. It can be implemented in less than 20 lines of MATLABTMand reduces the computation time from several hours to mere seconds. We show that our feature transformation reliably improves the results of SVM classification significantly on all our data sets - often outperforming SdAs and even deep neural networks in three out of four deep learning benchmarks.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

Perceptual-based deep-learning denoiser as a defense against adversarial attacks on ASR systems

Signal Analysis and Interpretation Laboratory (SAIL)（信号分析与解释实验室）；University of Southern California（南加州大学）

In this paper we investigate speech denoising as a defense against adversarial attacks on automatic speech recognition (ASR) systems. Adversarial attacks attempt to force misclassification by adding small perturbations to the original speech signal. We propose to counteract this by employing a neural-network based denoiser as a pre-processor in the ASR pipeline. The denoiser is independent of the downstream ASR model, and thus can be rapidly deployed in existing systems. We found that training the denoisier using a perceptually motivated loss function resulted in increased adversarial robustne…

2021-07-12cs.LGeess.ASeess.SP

通过智能分区实现深度EEG去噪器的无监督训练

Enabling Unsupervised Training of Deep EEG Denoisers With Intelligent Partitioning

Department of Electrical and Electronic Engineering, Imperial College London（帝国理工学院伦敦校区电子与电气工程系）；Dyson School of Design Engineering, Imperial College London（帝国理工学院伦敦校区戴森设计工程学院）

本文提出iPSD方法，通过学习将输入EEG段分割为独立的噪声实现，实现无监督去噪，尤其在低信噪比和复杂噪声下表现优异。

2026-09-29cs.AIcs.LGeess.SP

Document Image Classification with Intra-Domain Transfer Learning and Stacked Generalization of Deep Convolutional Neural Networks

Valeo India Pvt. Ltd.（法雷奥印度私人有限公司）；University of Bonn（波恩大学）；Indian Statistical Institute（印度统计研究所）

In this work, a region-based Deep Convolutional Neural Network framework is proposed for document structure learning. The contribution of this work involves efficient training of region based classifiers and effective ensembling for document image classification. A primary level of `inter-domain' transfer learning is used by exporting weights from a pre-trained VGG16 architecture on the ImageNet dataset to train a document classifier on whole document images. Exploiting the nature of region based influence modelling, a secondary level of `intra-domain' transfer learning is used for rapid train…

2018-08-30cs.CVcs.LG

SCGNet-Stacked Convolution with Gated Recurrent Unit Network：用于网络入侵检测与入侵类型分类的堆叠卷积门控循环单元网络

SCGNet-Stacked Convolution with Gated Recurrent Unit Network for Cyber Network Intrusion Detection and Intrusion Type Classification

American International University（美国国际大学）；Khulna University（库尔纳大学）

针对传统入侵检测系统难以高效识别复杂网络攻击的问题，提出新型深度学习架构SCGNet及通用数据预处理流程，在NSL-KDD数据集的攻击检测与分类任务上取得高准确率。

2024-10-29cs.CRcs.LG

Deep Learning in Alzheimer's disease: Diagnostic Classification and Prognostic Prediction using Neuroimaging Data

Indiana University School of Medicine（印第安纳大学医学院）；Indiana Alzheimer Disease Center（印第安纳阿尔茨海默病中心）；Indiana University Network Science Institute（印第安纳大学网络科学研究所）

Deep learning has shown outstanding performance in identifying intricate structures in complex high-dimensional data, especially in the domain of computer vision. The application of deep learning to early detection and automated classification of Alzheimer's disease (AD) has recently gained considerable attention, as rapid progress in neuroimaging techniques has generated large-scale multimodal neuroimaging data. A systematic review of publications using deep learning approaches and neuroimaging data for diagnostic classification of AD was performed. A PubMed and Google Scholar search was used…

2019-08-20cs.LGeess.IVstat.ML

Feature Learning and Classification in Neuroimaging: Predicting Cognitive Impairment from Magnetic Resonance Imaging

University of Victoria（维多利亚大学）

Due to the rapid innovation of technology and the desire to find and employ biomarkers for neurodegenerative disease, high-dimensional data classification problems are routinely encountered in neuroimaging studies. To avoid over-fitting and to explore relationships between disease and potential biomarkers, feature learning and selection plays an important role in classifier construction and is an important area in machine learning. In this article, we review several important feature learning and selection techniques including lasso-based methods, PCA, the two-sample t-test, and stacked auto-e…

2018-06-17cs.LGstat.ML

更多相关论文收起更多论文

Transport Analysis of Infinitely Deep Neural Network

RIKEN AIP（理化学研究所先进智能项目中心）；Waseda University（早稻田大学）

We investigated the feature map inside deep neural networks (DNNs) by tracking the transport map. We are interested in the role of depth (why do DNNs perform better than shallow models?) and the interpretation of DNNs (what do intermediate layers do?) Despite the rapid development in their application, DNNs remain analytically unexplained because the hidden layers are nested and the parameters are not faithful. Inspired by the integral representation of shallow NNs, which is the continuum limit of the width, or the hidden unit number, we developed the flow representation and transport analysis…

2018-10-31cs.LGstat.ML

Deep Packet: A Novel Approach For Encrypted Traffic Classification Using Deep Learning

Sharif University of Technology（谢里夫理工大学）

Internet traffic classification has become more important with rapid growth of current Internet network and online applications. There have been numerous studies on this topic which have led to many different approaches. Most of these approaches use predefined features extracted by an expert in order to classify network traffic. In contrast, in this study, we propose a \emph{deep learning} based approach which integrates both feature extraction and classification phases into one system. Our proposed scheme, called "Deep Packet," can handle both \emph{traffic characterization} in which the netw…

2018-07-04cs.CRcs.LGcs.NI

A Systematic Comparison of Deep Learning Architectures in an Autonomous Vehicle

Florida Atlantic University（佛罗里达大西洋大学）；Northeastern University（东北大学）

Self-driving technology is advancing rapidly --- albeit with significant challenges and limitations. This progress is largely due to recent developments in deep learning algorithms. To date, however, there has been no systematic comparison of how different deep learning architectures perform at such tasks, or an attempt to determine a correlation between classification performance and performance in an actual vehicle, a potentially critical factor in developing self-driving systems. Here, we introduce the first controlled comparison of multiple deep-learning architectures in an end-to-end auto…

2018-10-13cs.CVcs.LGcs.RO