arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1403.3305cs.NE
收藏

噪声对指数容量联想记忆的促进作用

Noise Facilitation in Associative Memories of Exponential Capacity

Amin Karbasi, Amir Hesam Salavati, Amin Shokrollahi, Lav R. Varshney

摘要:

通过结构化模式集和基于图的推理算法的联想记忆设计的最新进展已经允许可靠的学习和指数数量的模式的召回。虽然这些设计纠正了回忆中的外部错误,但它们假设神经元是无噪声计算的,而不是像海马体和嗅觉皮层这样的大脑区域中高度可变的神经元。在这里,我们认为联想记忆与嘈杂的内部计算和分析表征性能。只要内部噪声水平低于指定阈值,就可以使召回阶段的错误概率非常小。更令人惊讶的是,我们发现内部噪声实际上提高了回忆阶段的性能,而模式检索能力保持不变,即,所存储的模式的数量不会随着噪声而减少(直到阈值)。计算实验为我们的理论分析提供了额外的支持。这项工作表明,生物神经元网络中的噪声神经元具有功能性益处。

英文摘要:

Recent advances in associative memory design through structured pattern sets and graph-based inference algorithms have allowed reliable learning and recall of an exponential number of patterns. Although these designs correct external errors in recall, they assume neurons that compute noiselessly, in contrast to the highly variable neurons in brain regions thought to operate associatively such as hippocampus and olfactory cortex. Here we consider associative memories with noisy internal computations and analytically characterize performance. As long as the internal noise level is below a specified threshold, the error probability in the recall phase can be made exceedingly small. More surprisingly, we show that internal noise actually improves the performance of the recall phase while the pattern retrieval capacity remains intact, i.e., the number of stored patterns does not reduce with noise (up to a threshold). Computational experiments lend additional support to our theoretical analysis. This work suggests a functional benefit to noisy neurons in biological neuronal networks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑