Identifying stimulus-driven neural activity patterns is critical for studying the neural basis of cognition. This can be particularly challenging in intracranial datasets, where electrode locations typically vary across patients. This chapter first presents an overview of the major challenges to identifying stimulus-driven neural activity patterns in the general case. Next, we will review several modality-specific considerations and approaches, along with a discussion of several issues that are particular to intracranial recordings. Against this backdrop, we will consider a variety of within-subject and across-subject approaches to identifying and modeling stimulus-driven neural activity patterns in multi-patient intracranial recordings. These approaches include generalized linear models, multivariate pattern analysis, representational similarity analysis, joint stimulus-activity models, hierarchical matrix factorization models, Gaussian process models, geometric alignment models, inter-subject correlations, and inter-subject functional correlations. Examples from the recent literature serve to illustrate the major concepts and provide the conceptual intuitions for each approach.
Nonlinear Dynamical Modeling of Human Intracranial Brain Activity with Flexible Inference
Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California(明希学院电气与计算机工程系,维特比工程学院,南加州大学);Keck School of Medicine, University of Southern California(凯克医学院,南加州大学)
Neural correlates of perceptual consciousness from within: a narrative review of human intracranial research
Yale University(耶鲁大学);Univ. Grenoble Alpes, Univ. Savoie Mont Blanc, CNRS, LPNC(格勒诺布尔阿尔卑斯大学、萨瓦-蒙布朗大学、法国国家科学研究中心、LPNC);Neurology Department, CHU Grenoble Alpes, INSERM, U1216, Grenoble Institut Neurosciences(格勒诺布尔阿尔卑斯大学医院神经内科、INSERM U1216、格勒诺布尔神经科学研究所);Interdepartmental Neuroscience Program, Yale University(耶鲁大学跨学科神经科学项目);Department of Neurosurgery, Yale University(耶鲁大学神经外科系);Department of Neuroscience, Yale University(耶鲁大学神经科学系);St. Anne Univ. Hospital and Faculty of Medicine, Masaryk University(圣安妮大学医院与医学院,马萨里克大学);Behavioral and Social Neuroscience Research Group, CEITEC MU(行为与社会神经科学研究组,CEITEC MU);School of Psychological Sciences, Tel Aviv University(特拉维夫大学心理科学学院);Sagol School of Neuroscience, Tel Aviv University(特拉维夫大学萨戈尔神经科学学院);Brain, Mind, and Consciousness Program, Canadian Institute for Advanced Research (CIFAR)(大脑、心智与意识项目,加拿大高等研究院(CIFAR));Department of Neurosurgery, The University of Alabama in Birmingham(阿拉巴马大学伯明翰分校神经外科系);Univ. Grenoble Alpes, Inserm, U1216, Grenoble Institut Neurosciences(格勒诺布尔阿尔卑斯大学、INSERM U1216、格勒诺布尔神经科学研究所)
Decoding Dynamic Visual Experience from Calcium Imaging via Cell-Pattern-Aware Pretraining
Interdisciplinary Program in Artificial Intelligence(人工智能跨学科项目);Seoul National University(首尔国立大学);NSF AI Institute for Artificial and Natural Intelligence (ARNI)(国家科学基金会人工智能与自然智能研究院);Columbia University(哥伦比亚大学);Mila (Quebec AI Institute)(蒙特利尔人工智能研究所);Dept. of Neurology & Neurosurgery(神经病学与神经外科系);McGill University(麦吉尔大学);Montreal Neurological Institute, McGill University(麦吉尔大学蒙特利尔神经科学研究所);School of Computer Science, McGill University(麦吉尔大学计算机科学学院);Learning in Machines and Brains Program, CIFAR(机器与大脑学习计划,CIFAR);Department of Psychology(心理学系);Department of Brain and Cognitive Sciences(脑与认知科学系)
An electronic neuromorphic system for real-time detection of High Frequency Oscillations (HFOs) in intracranial EEG
Institute of Neuroinformatics, University of Zurich and ETH Zurich(苏黎世大学与苏黎世联邦理工学院神经信息学研究所);UniversitätsSpital und Universität Zürich(苏黎世大学医院与苏黎世大学)
在这项工作中,我们提出了一种神经形态系统,该系统首次将神经记录头台与信号-尖峰转换电路和多核尖峰神经网络(SNN)架构结合在同一个模具上,用于记录,处理和检测高频振荡(HFO),这是致痫区的生物标志物。该器件采用标准的0.18 $μ$ m CMOS工艺节点制造,总面积为99 mm $^{2}$。我们证明了它的应用程序HFO检测记录从9例颞叶癫痫患者随后接受癫痫手术的iEEG。芯片在检测任务期间的总平均功耗为614.3 $μ$ W。我们展示了神经形态学系统如何可靠地检测HFO:该系统以最先进的准确性,特异性和灵敏度(分别为78%,100%和33%)预测术后癫痫发作结果。这是第一个可行性研究,旨在使用基于事件的处理器和尖峰神经网络实时、片上识别颅内人体数据中的相关特征。通过向神经记录电路提供“神经形态智能”,所提出的方法将为开发能够直接在手术室中检测HFO区域并改善癫痫手术的癫痫发作结果的系统铺平道路。
BrainStratify: Coarse-to-Fine Disentanglement of Intracranial Neural Dynamics
Beijing Normal University(北京师范大学);Peking University(北京大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Chinese Institute for Brain Research(中国脑科学研究院);Capital Medical University, Xuanwu Hospital, Beijing(首都医科大学宣武医院)
Integrating Artificial Intelligence with Real-time Intracranial EEG Monitoring to Automate Interictal Identification of Seizure Onset Zones in Focal Epilepsy
University of Illinois(伊利诺伊大学);Mayo Clinic(梅奥诊所);Czech Institute of Informatics, Robotics and Cybernetics(捷克信息学、机器人学与控制论研究所);Czech Technical University in Prague(布拉格捷克理工大学)
Accurate Decoding of Natural Sentences from Non-Invasive Brain Recordings
Meta AI;École Normale Supérieure(高等师范学院);Université PSL(巴黎文理大学);CNRS(法国国家科学研究中心);Hospital Foundation Adolphe de Rothschild(阿道夫·德·罗斯柴尔德医院基金会);Univ. Lille(里尔大学);Basque Center on Cognition, Brain and Language(巴斯克认知、大脑与语言中心);Paris Cité University(巴黎城市大学);Inria(法国国家信息与自动化研究所);Université Paris-Saclay(巴黎萨克雷大学);INSERM(法国国家健康与医学研究院);CEA(法国原子能和替代能源委员会)
Towards Unified Neural Decoding with Brain Functional Network Modeling
Westlake University(西湖大学);Zhejiang University School of Medicine First Affiliated Hospital(浙江大学医学院附属第一医院);Westlake Institute for Optoelectronics(西湖光电研究院)
Du-IN: Discrete units-guided mask modeling for decoding speech from Intracranial Neural signals
Peking University(北京大学);Chinese Institute for Brain Research(中国脑科学研究院);Beijing Normal University(北京师范大学);Shanghai Jiao Tong University(上海交通大学);Capital Medical University(首都医科大学);Xuanwu Hospital(宣武医院)
Generative Modeling of Neural Dynamics via Latent Stochastic Differential Equations
Department of Machine Learning and Neural Computing, Donders Institute for Brain, Cognition and Behaviour, Radboud University(机器学习与神经计算系,脑认知与行为研究所,拉德堡德大学)
The Repeated-Stimulus Confound in Electroencephalography
Hamilton Institute, Maynooth University(马尼穆希大学哈密尔顿研究所);Department of Computer Science, Maynooth University(马尼穆希大学计算机科学系);Elmore Family School of Electrical and Computer Engineering, Purdue University(普渡大学埃洛姆家族电气与计算机工程学院)
Estimation of neuronal interaction graph from spike train data
当前神经生物学的主要问题之一是了解多神经元集合之间的相关尖峰活动以及神经生理学实验中刺激驱动和自发活动之间的差异。现在普遍使用的多电极阵列记录以来自许多良好识别的神经元的脉冲序列的形式监测神经元活动。分析这些数据时的一个基本问题是识别描述神经元之间"突触耦合"的有向图。在这篇文章中,我们处理这个问题与高质量的多电极阵列记录数据集(Pouzat等人,2015年)从蝗虫的第一个嗅觉中继,$Schistocerca$ $americana$。从数学的角度来看,本文提出了两个新的。首先,我们提出了一个程序,允许处理实际数据集中遇到的小样本量。此外,我们解决部分观察网络的敏感情况。我们的出发点是Duarte et al.(2016)中介绍的程序。我们通过模拟研究,这也是用于参数调整和探索只记录一个小的子集的网络的神经元的影响,原始和改进的程序的性能进行评估。
Fractal and Multifractal Properties of Electrographic Recordings of Human Brain Activity: Toward Its Use as a Signal Feature for Machine Learning in Clinical Applications