A key challenge in understanding the sensory transformations of the visual system is to obtain a highly predictive model of responses from visual cortical neurons. Deep neural networks (DNNs) provide a promising candidate for such a model. However, DNNs require orders of magnitude more training data than neuroscientists can collect from real neurons because experimental recording time is severely limited. This motivates us to find images that train highly-predictive DNNs with as little training data as possible. We propose gaudy images---high-contrast binarized versions of natural images---to efficiently train DNNs. In extensive simulation experiments, we find that training DNNs with gaudy images substantially reduces the number of training images needed to accurately predict the simulated responses of visual cortical neurons. We also find that gaudy images, chosen before training, outperform images chosen during training by active learning algorithms. Thus, gaudy images overemphasize features of natural images, especially edges, that are the most important for efficiently training DNNs. We believe gaudy images will aid in the modeling of visual cortical neurons, potentially opening new scientific questions about visual processing, as well as aid general practitioners that seek ways to improve the training of DNNs.
DeepRetinotopy: Predicting the Functional Organization of Human Visual Cortex from Structural MRI Data using Geometric Deep Learning
School of Psychology, The University of Queensland(昆士兰大学心理学院);Queensland Brain Institute, The University of Queensland(昆士兰大学昆士兰脑研究所);Centre for Advanced Imaging, The University of Queensland(昆士兰大学高级成像中心)
Future Video Generation Better Aligns with the Human Visual Cortex than Observed Video
Yonsei University College of Medicine(延世大学医学院);Institute of Behavioral Sciences in Medicine, Yonsei University College of Medicine(延世大学医学院行为科学研究所);Department of Biomedical Systems Informatics, Yonsei University College of Medicine(延世大学医学院生物医学系统信息学系);Korea University(高丽大学);Yonsei Institute for Digital Healthcare, Yonsei University(延世大学数字医疗研究所)
A General Framework for Development of the Cortex-like Visual Object Recognition System: Waves of Spikes, Predictive Coding and Universal Dictionary of Features
Parcellation of Visual Cortex on high-resolution histological Brain Sections using Convolutional Neural Networks
1 Institute of Neuroscience;O. Vogt Institute for Brain Research, Heinrich-Heine University D\"usseldorf, Germany 3 Institut f\"ur Informatik, Heinrich-Heine University D\"usseldorf, Germany
Towards robust vision by multi-task learning on monkey visual cortex
Institute for Bioinformatics and Medical Informatics, University Tübingen(蒂宾根大学生物信息学与医学信息学研究所);Columbia University, Department of Psychiatry(哥伦比亚大学精神病学系);International Max Planck Research School for Intelligent Systems(国际马克斯·普朗克智能系统研究学院);Institute for Computer Science, University of Göttingen(哥廷根大学计算机科学研究所);Department for Neuroscience, Baylor College of Medicine(贝勒医学院神经科学系);Center for Neuroscience and Artificial Intelligence, Baylor College of Medicine(贝勒医学院神经科学与人工智能中心)
Decoding Visual Experience and Mapping Semantics through Whole-Brain Analysis Using fMRI Foundation Models
Department of Psychiatry and Behavioral Sciences, Stanford University(精神病学与行为科学系,斯坦福大学);Department of Computer Science, Stanford University(计算机科学系,斯坦福大学);Department of Neurobiology, University of Chicago(神经生物学系,芝加哥大学);Google DeepMind(谷歌DeepMind)
A Sinc Wavelet Describes the Receptive Fields of Neurons in the Motion Cortex
Quantum Lucid Research Laboratories(量子清晰研究实验室)
视觉感知来自于流经视觉系统的信息的系统转换。在神经元层级中,单个神经元的响应特性由位于下一级的神经元确定,并且反过来,确定位于上一级的神经元的响应。因此,在感受野建模中,必须确保通过组合其输入水平中的神经元的响应模型来生成给定水平中的神经元的响应特性。然而,运动皮层中神经元的现有响应模型并不固有地产生时间频率滤波梯度(TFFG)特性,所述时间频率滤波梯度(TFFG)特性已知沿着初级视觉皮层(V1)到中间时间(MT)运动处理流出现。TFFG是沿V1至MT通路从主要低通到主要带通的时间频率滤波特征的变化(Foster et al 1985; DeAngelis et al 1993; Hawken et al 1996)。我们设计了一个新的模型,sinc小波模型(Odaibo,2014),它逻辑上有效地生成了TFFG。该模型用sinc(sin(x)/x)函数取代了Gabor函数的正弦波载波,并且具有与现有模型相同或更少数量的参数。由于sinc小波与TFFG的突现网络性质在逻辑上是一致的,我们认为sinc小波是运动皮层神经元感受野的一个较好的模型。该模型将为大脑如何表达视觉信息提供新的生理学见解。
Performance-optimized deep neural networks are evolving into worse models of inferotemporal visual cortex
Brown University(布朗大学);Carney Institute for Brain Science, Brown University(布朗大学卡尼脑科学研究所);Artificial and Natural Intelligence Toulouse Institute(图卢兹人工与自然智能研究所);University of Pennsylvania(宾夕法尼亚大学);Harvard Medical School(哈佛医学院)
Task learning increases information redundancy of neural responses in macaque visual cortex
Department of Brain and Cognitive Sciences, University of Rochester(脑科学与认知科学系,罗切斯特大学);Center for Visual Science, University of Rochester(视觉科学中心,罗切斯特大学);Department of Computer Science, University of Rochester(计算机科学系,罗切斯特大学);Department of Physics & Astronomy, University of Rochester(物理与天文学系,罗切斯特大学);Department of Neuroscience, University of Rochester(神经科学系,罗切斯特大学)
Relationships between the degrees of freedom in the affine Gaussian derivative model for visual receptive fields and 2-D affine image transformations, with application to covariance properties of simple cells in the primary visual cortex
Computational Brain Science Lab(计算脑科学实验室);Division of Computational Science and Technology(计算科学与技术系);KTH Royal Institute of Technology(皇家理工学院)
Primary visual cortex contributes to color constancy by predicting rather than discounting the illuminant: evidence from a computational study
College of Computer Science, Sichuan University(四川大学计算机学院);School of Life Science and Technology, University of Electronic Science and Technology of China(电子科技大学生命科学与技术学院)
STSBench: A Large-Scale Dataset for Modeling Neuronal Activity in the Dorsal Stream of Primate Visual Cortex
Neuroscience Interdepartmental Program, Stanford University(斯坦福大学神经科学跨学科项目);Department of Neurobiology, Stanford University(斯坦福大学神经生物学系);Howard Hughes Medical Institute, Stanford University(斯坦福大学霍华德·霍夫曼医学研究所)
A Robust Point Cloud Analysis Framework Inspired By Primary Visual Cortex
School of Information Science and Engineering, Lanzhou University(兰州大学信息科学与工程学院);School of Medical Technology, Beijing Institute of Technology(北京理工大学医学技术学院);Cloud and AI BU, Huawei(华为云与AI业务部);School of Computing, National University of Singapore(新加坡国立大学计算机学院)
Visual attention information can be traced on cortical response but not on the retina: evidence from electrophysiological mouse data using natural images as stimuli
The Pictorial Cortex: Zero-Shot Cross-Subject fMRI-to-Image Reconstruction via Compositional Latent Modeling
Institute of Science and Technology for Brain-inspired Intelligence (ISTBI), Fudan University(脑启发智能科学与技术研究院,复旦大学);School of Data Science, Fudan University(复旦大学数据科学学院);Fudan ISTBI–ZJNU Algorithm Centre for Brain-Inspired Intelligence, Zhejiang Normal University(复旦ISTBI-浙师大脑启发智能算法中心,浙江师范大学);Shanghai Innovation Institute(上海创新研究院);Nanyang Technological University(南洋理工大学)