KCNet:一种受昆虫启发、具有随机二值权重的单隐藏层神经网络,用于预测与分类任务
KCNet: An Insect-Inspired Single-Hidden-Layer Neural Network with Randomized Binary Weights for Prediction and Classification Tasks
AI总结:
该研究借鉴果蝇嗅觉系统的随机稀疏投射机制,提出单隐藏层KCNet及动态输入优化算法,在气味预测中优于XGBoost,并在多个图像基准上快速取得合理性能。
摘要:
果蝇是研究嗅觉学习的成熟模型系统,因为它们很容易学会将气味与电击或糖奖励联系起来。昆虫脑中明显负责气味学习的机制形成了一种相对浅层的神经元架构。嗅觉输入由脑的触角叶(AL)接收,触角叶在约50个被称为肾小球的亚单元中产生对每种气味混合物的编码。随后,每个肾小球将该特征向量的对应分量投射到被称为蘑菇体(MB)的脑区中约2000个所谓的Kenyon细胞(KC)中的若干个。果蝇对气味的反应由小型下游神经元产生,这些神经元解码来自蘑菇体的高阶表征。研究表明,肾小球—KC连接(以及由此产生的特定高阶表征)中不存在可识别的模式;它们类似于指纹——即使是等基因果蝇也具有不同的投射。利用来自这一架构的洞见,我们提出了KCNet,这是一种单隐藏层神经网络,其输入层与隐藏层之间包含稀疏、随机的二值权重,而隐藏层与输出层之间则采用解析方式学习权重。此外,我们还提出了一种动态优化算法,使KCNet能够通过搜索更有效的输入集合,将性能提升到其结构限制之外。对于预测气味物质感知属性的气味感知任务,我们表明KCNet优于现有数据驱动方法,例如XGBoost。对于图像分类任务,KCNet在不使用任何数据增强方法或卷积层的情况下,在基准数据集(MNIST、Fashion-MNIST和EMNIST)上取得了合理的性能,并表现出特别快的运行时间。
英文摘要:
Fruit flies are established model systems for studying olfactory learning as they will readily learn to associate odors with both electric shock or sugar rewards. The mechanisms of the insect brain apparently responsible for odor learning form a relatively shallow neuronal architecture. Olfactory inputs are received by the antennal lobe (AL) of the brain, which produces an encoding of each odor mixture across ~50 sub-units known as glomeruli. Each of these glomeruli then projects its component of this feature vector to several of ~2000 so-called Kenyon Cells (KCs) in a region of the brain known as the mushroom body (MB). Fly responses to odors are generated by small downstream neutrophils that decode the higher-order representation from the MB. Research has shown that there is no recognizable pattern in the glomeruli--KC connections (and thus the particular higher-order representations); they are akin to fingerprints--even isogenic flies have different projections. Leveraging insights from this architecture, we propose KCNet, a single-hidden-layer neural network that contains sparse, randomized, binary weights between the input layer and the hidden layer and analytically learned weights between the hidden layer and the output layer. Furthermore, we also propose a dynamic optimization algorithm that enables the KCNet to increase performance beyond its structural limits by searching for a more efficient set of inputs. For odorant-perception tasks that predict the perceptual properties of an odorant, we show that KCNet outperforms existing data-driven approaches, such as XGBoost. For image classification tasks, KCNet achieves reasonable performance on benchmark datasets (MNIST, Fashion-MNIST, and EMNIST) without any data-augmentation methods or convolutional layers and shows a particularly fast running time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。