Decoding Dynamic Visual Experience from Calcium Imaging via Cell-Pattern-Aware Pretraining
Interdisciplinary Program in Artificial Intelligence(人工智能跨学科项目);Seoul National University(首尔国立大学);NSF AI Institute for Artificial and Natural Intelligence (ARNI)(国家科学基金会人工智能与自然智能研究院);Columbia University(哥伦比亚大学);Mila (Quebec AI Institute)(蒙特利尔人工智能研究所);Dept. of Neurology & Neurosurgery(神经病学与神经外科系);McGill University(麦吉尔大学);Montreal Neurological Institute, McGill University(麦吉尔大学蒙特利尔神经科学研究所);School of Computer Science, McGill University(麦吉尔大学计算机科学学院);Learning in Machines and Brains Program, CIFAR(机器与大脑学习计划,CIFAR);Department of Psychology(心理学系);Department of Brain and Cognitive Sciences(脑与认知科学系)
Sangyoon Bae, Mehdi Azabou, Blake Richards, Jiook Cha
Neural recordings exhibit a distinctive form of heterogeneity rooted in differences in cell types, intrinsic circuit dynamics, and stochastic stimulus-response variability that goes beyond ordinary dataset variability, mixing statistically regular neurons with highly stochastic, stimulus-contingent ones within the same dataset. This heterogeneity poses a challenge for self-supervised learning (SSL) -- learnable statistical regularity -- thereby destabilizing representation learning and limiting reliable scaling. We introduce POYO-CAP (Cell-pattern Aware Pretraining), a biologically grounded hybrid pretraining strategy that first trains with masked reconstruction plus lightweight auxiliary supervision on statistically regular neurons -- identified via skewness and kurtosis -- and then fine-tunes on more stochastic populations. On the Allen Brain Observatory dataset, this curriculum yields 12--13\% relative improvements over from-scratch training and enables smooth, monotonic scaling with model size, whereas baselines trained on mixed populations plateau or destabilize. By making statistical predictability an explicit data-selection criterion, POYO-CAP turns neural heterogeneity into a scalable learning advantage for robust neural decoding.
Application of an attention-based CNN-BiLSTM framework for in vivo two-photon calcium imaging of neuronal ensembles: decoding complex bilateral forelimb movements from unilateral M1
West Virginia University(西弗吉尼亚大学);University of Miami(迈阿密大学);Leonard M. Miller School of Medicine(伦纳德·M·米勒医学院);Rockefeller Neuroscience Institute(洛克菲勒神经科学研究所)
GeoNIRS: Geometry-Aware Pretraining for Heterogeneous fNIRS Representation Learning
Southern University of Science and Technology(南方科技大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Omni-Intelligence(奥米智能);Shenzhen Loop Area Institute(深圳河套学院)
Generalizable, real-time neural decoding with hybrid state-space models
Mila – Quebec AI Institute(Mila – 魁北克人工智能研究院);Université de Montréal(蒙特利尔大学);Columbia University(哥伦比亚大学);University of Pennsylvania(宾夕法尼亚大学);Canada CIFAR AI Chair(加拿大CIFAR人工智能教席)
Improving Speech Decoding from ECoG with Self-Supervised Pretraining
Institute of Neuroinformatics(神经信息学研究所);University of Zurich(苏黎世大学);ETH Zurich(苏黎世联邦理工学院);School of Electrical and Computer Engineering(电气与计算机工程学院);Purdue University(普渡大学)
BrainWideBench: Benchmarking large-scale pretraining and across-animal transfer in multi-region neural recordings
University of Pennsylvania(宾夕法尼亚大学);Mila(米拉研究所);Université de Montréal(蒙特利尔大学);Stanford University(斯坦福大学);Columbia University(哥伦比亚大学);Allen Institute(艾伦研究所);William James Center for Research(威廉·詹姆斯研究中心);ISPA - Instituto Universitário(ISPA 大学研究所);University of Geneva(日内瓦大学);Karolinska Institutet(卡罗林斯卡学院);UCLA(加州大学洛杉矶分校);University College London(伦敦大学学院);Champalimaud Foundation(尚帕利莫基金会);Lingang Laboratory(临港实验室);The Chinese University of Hong Kong(香港中文大学);Donders Institute(唐德斯研究所);University of Minnesota(明尼苏达大学);Princeton University(普林斯顿大学);Leiden University(莱顿大学);McGill University(麦吉尔大学);IBM
R&B -- Rhythm and Brain: Cross-subject Decoding of Music from Human Brain Activity
Department of Biomedicine and Prevention University of Rome Tor Vergata(生物医学与预防系罗马大学托尔维加塔分校);A.A. Martinos Center for Biomedical Imaging Harvard Medical School/MGH, Boston (US)(A.A. Martinos生物医学成像中心哈佛医学院/马萨诸塞总医院,波士顿(美国))