arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 0706.3177q-bio.NC
收藏

稳态在稀疏表征学习中的作用

Role of homeostasis in learning sparse representations

Laurent Perrinet

摘要:

灵长类动物初级视觉皮层输入层神经元形成边缘状感受野。理解这种反应的出现的一种方法是指出,神经活动必须有效地表示与自然场景的统计相关的感觉数据。此外,据信,这种有效的编码是使用跨神经元的竞争来实现的,以便生成稀疏表示,即,其中相对少量的神经元同时活跃。事实上,稀疏编码的不同模型,再加上赫布学习和稳态,已经提出了成功地匹配观察到的紧急反应。然而,稳态在学习这种稀疏表示中的具体作用在很大程度上仍然未知。通过定量评估学习过程中神经表征的效率,我们推导出一种合作的稳态机制,该机制优化了稀疏编码算法中神经元之间的竞争。我们在学习从自然图像中获取的小块图像时应用这种稳态,并将其效率与最先进的算法进行比较。结果表明,虽然不同的稀疏编码算法给出了类似的编码结果,但稳态为神经元群体内的自然图像的表示提供了最佳平衡。稀疏编码中的竞争在公平的情况下是最优化的。通过有助于优化神经元之间的统计竞争,稳态在为独立组件的出现提供更有效的解决方案方面至关重要。

英文摘要:

Neurons in the input layer of primary visual cortex in primates develop edge-like receptive fields. One approach to understanding the emergence of this response is to state that neural activity has to efficiently represent sensory data with respect to the statistics of natural scenes. Furthermore, it is believed that such an efficient coding is achieved using a competition across neurons so as to generate a sparse representation, that is, where a relatively small number of neurons are simultaneously active. Indeed, different models of sparse coding, coupled with Hebbian learning and homeostasis, have been proposed that successfully match the observed emergent response. However, the specific role of homeostasis in learning such sparse representations is still largely unknown. By quantitatively assessing the efficiency of the neural representation during learning, we derive a cooperative homeostasis mechanism that optimally tunes the competition between neurons within the sparse coding algorithm. We apply this homeostasis while learning small patches taken from natural images and compare its efficiency with state-of-the-art algorithms. Results show that while different sparse coding algorithms give similar coding results, the homeostasis provides an optimal balance for the representation of natural images within the population of neurons. Competition in sparse coding is optimized when it is fair. By contributing to optimizing statistical competition across neurons, homeostasis is crucial in providing a more efficient solution to the emergence of independent components.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑