首页/论文/2005.04170

arXiv 2005.041702020-05cs.NEcs.ETcs.LGstat.ML

A Neuromorphic Paradigm for Online Unsupervised Clustering

University of Wisconsin-Madison（威斯康星大学麦迪逊分校）；Carnegie Mellon University（卡内基梅隆大学）

James E. Smith

备注：: Submitted to 53rd IEEE/ACM International Symposium on Microarchitecture

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

英文摘要相关论文

英文摘要：

A computational paradigm based on neuroscientific concepts is proposed and shown to be capable of online unsupervised clustering. Because it is an online method, it is readily amenable to streaming realtime applications and is capable of dynamically adjusting to macro-level input changes. All operations, both training and inference, are localized and efficient. The paradigm is implemented as a cognitive column that incorporates five key elements: 1) temporal coding, 2) an excitatory neuron model for inference, 3) winner-take-all inhibition, 4) a column architecture that combines excitation and inhibition, 5) localized training via spike timing de-pendent plasticity (STDP). These elements are described and discussed, and a prototype column is given. The prototype column is simulated with a semi-synthetic benchmark and is shown to have performance characteristics on par with classic k-means. Simulations reveal the inner operation and capabilities of the column with emphasis on excitatory neuron response functions and STDP implementations.

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

阅读原文

阅读 PDF ↗

arXiv 页面 ↗HTML 原文 ↗

本文内容

英文摘要相关论文

机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。

继续探索

相关论文

基于神经形态计算的无监督粒子径迹追踪

Unsupervised Particle Tracking with Neuromorphic Computing

INFN（意大利国家核物理研究所）；Università di Padova（帕多瓦大学）；Università di Bologna（博洛尼亚大学）；Luleå University of Technology（吕勒奥理工大学）；Central University of Tamil Nadu（泰米尔纳德邦中央大学）

本文提出利用脉冲神经网络和脉冲时间依赖可塑性规则，在CMS Phase II探测器几何模型下以完全无监督方式从高噪声击中数据中识别带电粒子径迹，为高能物理实时低功耗径迹追踪开辟新方向。

2025-02-10cs.ETcs.LGcs.NE

Membrane-Dependent Neuromorphic Learning Rule for Unsupervised Spike Pattern Detection

Several learning rules for synaptic plasticity, that depend on either spike timing or internal state variables, have been proposed in the past imparting varying computational capabilities to Spiking Neural Networks. Due to design complications these learning rules are typically not implemented on neuromorphic devices leaving the devices to be only capable of inference. In this work we propose a unidirectional post-synaptic potential dependent learning rule that is only triggered by pre-synaptic spikes, and easy to implement on hardware. We demonstrate that such a learning rule is functionally …

2017-01-05cs.NE

A Memristor based Unsupervised Neuromorphic System Towards Fast and Energy-Efficient GAN

Deep Learning has gained immense success in pushing today's artificial intelligence forward. To solve the challenge of limited labeled data in the supervised learning world, unsupervised learning has been proposed years ago while low accuracy hinters its realistic applications. Generative adversarial network (GAN) emerges as an unsupervised learning approach with promising accuracy and are under extensively study. However, the execution of GAN is extremely memory and computation intensive and results in ultra-low speed and high-power consumption. In this work, we proposed a holistic solution f…

2019-09-08cs.CVcs.DCcs.ET

神经形态在线聚类与分类

Neuromorphic Online Clustering and Classification

本文提出一种基于主动脉冲树突模型的神经形态架构，单个树突段等效于积分-发放神经元，多个树突段实现在线聚类，多树突加投票机制实现在线监督分类，为替代反向传播的类脑学习方法奠定基础。

2023-10-26cs.NE

Brain-inspired self-organization with cellular neuromorphic computing for multimodal unsupervised learning

CNRS（法国国家科学研究中心）；LEAT（电子、天线与电信实验室）

Cortical plasticity is one of the main features that enable our ability to learn and adapt in our environment. Indeed, the cerebral cortex self-organizes itself through structural and synaptic plasticity mechanisms that are very likely at the basis of an extremely interesting characteristic of the human brain development: the multimodal association. In spite of the diversity of the sensory modalities, like sight, sound and touch, the brain arrives at the same concepts (convergence). Moreover, biological observations show that one modality can activate the internal representation of another mod…

2020-09-02cs.LGcs.NEq-bio.NC

Real time unsupervised learning of visual stimuli in neuromorphic VLSI systems

Neuromorphic chips embody computational principles operating in the nervous system, into microelectronic devices. In this domain it is important to identify computational primitives that theory and experiments suggest as generic and reusable cognitive elements. One such element is provided by attractor dynamics in recurrent networks. Point attractors are equilibrium states of the dynamics (up to fluctuations), determined by the synaptic structure of the network; a `basin' of attraction comprises all initial states leading to a given attractor upon relaxation, hence making attractor dynamics su…

2015-06-17cs.NEq-bio.NC

更多相关论文收起更多论文

神经形态在线聚类及其在锋电位分类中的应用

Neuromorphic Online Clustering and Its Application to Spike Sorting

University of Wisconsin-Madison（威斯康星大学麦迪逊分校）

本研究提出基于传统机器学习符号的活性树突公式化表述，开发出可动态在线聚类的神经形态树突模块，在锋电位分类任务中性能优于离线k-means，且支持单次遍历输入流的在线学习。

2025-06-14cs.AIcs.NE

Unsupervised Online Learning With Multiple Postsynaptic Neurons Based on Spike-Timing-Dependent Plasticity Using a TFT-Type NOR Flash Memory Array

We present a two-layer fully connected neuromorphic system based on a thin-film transistor (TFT)-type NOR flash memory array with multiple postsynaptic (POST) neurons. Unsupervised online learning by spike-timing-dependent plasticity (STDP) on the binary MNIST handwritten datasets is implemented, and its recognition result is determined by measuring firing rate of POST neurons. Using a proposed learning scheme, we investigate the impact of the number of POST neurons in terms of recognition rate. In this neuromorphic system, lateral inhibition function and homeostatic property are exploited for…

2018-11-17cs.ETcs.NE

Deep Unsupervised Clustering with Gaussian Mixture Variational Autoencoders

Imperial College London（帝国理工学院）

We study a variant of the variational autoencoder model (VAE) with a Gaussian mixture as a prior distribution, with the goal of performing unsupervised clustering through deep generative models. We observe that the known problem of over-regularisation that has been shown to arise in regular VAEs also manifests itself in our model and leads to cluster degeneracy. We show that a heuristic called minimum information constraint that has been shown to mitigate this effect in VAEs can also be applied to improve unsupervised clustering performance with our model. Furthermore we analyse the effect of …

2017-01-13cs.LGcs.NEstat.ML

Unsupervised Competitive Hardware Learning Rule for Spintronic Clustering Architecture

We propose a hardware learning rule for unsupervised clustering within a novel spintronic computing architecture. The proposed approach leverages the three-terminal structure of domain-wall magnetic tunnel junction devices to establish a feedback loop that serves to train such devices when they are used as synapses in a neuromorphic computing architecture.

2020-03-24cs.ETcs.NEphysics.app-ph

面向混合信号神经形态处理器的梯度下降硬件感知训练与部署

Gradient-descent hardware-aware training and deployment for mixed-signal Neuromorphic processors

SynSense AG（森赛思公司）

本文提出一种面向混合信号神经形态处理器DYNAP-SE2的硬件感知训练与部署方法，通过可微仿真、无监督权重量化和参数噪声注入提升SNN对硬件非理想性的鲁棒性，并扩展Rockpool库以简化部署流程。

2024-02-15cs.ETcs.LGcs.NE

On the Self-Repair Role of Astrocytes in STDP Enabled Unsupervised SNNs

Neuromorphic computing is emerging to be a disruptive computational paradigm that attempts to emulate various facets of the underlying structure and functionalities of the brain in the algorithm and hardware design of next-generation machine learning platforms. This work goes beyond the focus of current neuromorphic computing architectures on computational models for neuron and synapse to examine other computational units of the biological brain that might contribute to cognition and especially self-repair. We draw inspiration and insights from computational neuroscience regarding functionalit…

2020-11-16cs.NE

TNNGen：面向时间序列聚类的神经形态感知处理单元自动化设计

TNNGen: Automated Design of Neuromorphic Sensory Processing Units for Time-Series Clustering

Carnegie Mellon University（卡内基梅隆大学）

TNNGen提出从PyTorch模型到布局后网表的时序神经网络自动化设计流程，结合功能仿真器与硬件生成器，并通过七种时间序列聚类设计验证其有效性。

2024-12-23cs.AIcs.ARcs.NE

NeuSort：一种基于神经形态模型的自动自适应锋电位分类方法

NeuSort: An Automatic Adaptive Spike Sorting Approach with Neuromorphic Models

NeuSort是一种基于神经形态模型的在线锋电位分类方法，通过可塑性学习机制实现自适应调整，能够实时跟踪波形形变并识别新神经元，满足脑机接口中低能耗、即插即用的实时分类需求。

2023-09-17cs.NE