Human speech is the most important part of General Artificial Intelligence and subject of much research. The hypothesis proposed in this article provides explanation of difficulties that modern science tackles in the field of human brain simulation. The hypothesis is based on the author's conviction that the brain of any given person has different ability to process and store information. Therefore, the approaches that are currently used to create General Artificial Intelligence have to be altered.
Mechanistic Interpretability of Brain-to-Speech Models Across Speech Modes
Department of Computer Science, University of Maryland, College Park, United States(计算机科学系,马里兰大学,College Park,美国);Department of Electrical and Computer Engineering, University of Maryland, College Park, United States(电气与计算机工程系,马里兰大学,College Park,美国)
fMRI2GES: Co-speech Gesture Reconstruction from fMRI Signal with Dual Brain Decoding Alignment
College of Information Science and Engineering, Hunan University(湖南大学信息科学与工程学院);School of Computer Science and Technology, Nanjing University of Science and Technology(南京理工大学计算机科学与技术学院);Department of Automation, Tsinghua University(清华大学自动化系)
Toward a realistic model of speech processing in the brain with self-supervised learning
Ecole Normale Supérieure, PSL University(巴黎高等师范学院,巴黎文理研究大学);Université de Paris cité(巴黎城市大学);Université Paris-Saclay(巴黎萨克雷大学);Inria(法国国家信息与自动化研究所);CEA(法国原子能和替代能源委员会);University of Toronto(多伦多大学);INSERM(法国国家健康与医学研究院);Meta AI
An Approach to Simultaneous Acquisition of Real-Time MRI Video, EEG, and Surface EMG for Articulatory, Brain, and Muscle Activity During Speech Production
Signal Analysis and Interpretation Laboratory, University of Southern California(南加州大学信号分析与解释实验室);Ming Hsieh Dept. of Electrical and Computer Engineering, University of Southern California(南加州大学明希斯电气与计算机工程系);Dept. of Linguistics, University of Southern California(南加州大学语言学系)
Towards unified brain-to-text decoding across speech production and perception
Computer Science and Technology(计算机科学与技术);Zhejiang University(浙江大学);Shanghai Institute of Microsystem and Information Technology(上海微系统与信息工程研究所);Chinese Academy of Sciences(中国科学院);Department of Neurosurgery(神经外科部门);Huashan Hospital, Fudan University(复旦大学华山医院)
本文提出一种统一的脑-句子解码框架,用于 Mandarin Chinese 的语音生成与感知,通过单字符数据训练实现句子级解码,并通过多模态神经动态比较提升解码性能。
Subject-Invariant Cross-Modal Decoding of Perceived Speech from Brain Recordings
School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);Academy for Advanced Interdisciplinary Studies, Peking University(北京大学前沿交叉学科研究院);National Key Laboratory of General Artificial Intelligence(通用人工智能全国重点实验室)
Cross-Subject Generalization in Decoding Perceived Speech from Non-Invasive Brain Recordings
School of Intelligence Science and Technology, Peking University(北京大学智能科学与技术学院);Academy for Advanced Interdisciplinary Studies, Peking University(北京大学前沿交叉学科研究院);National Key Laboratory of General Artificial Intelligence(通用人工智能国家重点实验室)
MindAlign: Decoding Inner Speech from fMRI Signals via Multimodal Embedding Alignment under Limited Data
Graduate School of Humanities and Sciences Ochanomizu University(大仓山大学人文科学研究生院);Center for Information and Neural Networks Advanced ICT Research Institute National Institute of Information and Communications Technology(信息与神经网络中心先进信息通信研究机构信息通信技术研究所)
VoiceMem: Streaming Dual-Brain Memory for Real-Time Interaction
Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学);Tsinghua University(清华大学);The Chinese University of Hong Kong(香港中文大学)
Deep Neural Networks and Brain Alignment: Brain Encoding and Decoding (Survey)
Inria Bordeaux(法国国家信息与自动化研究所波尔多分所);LaBRI, Université de Bordeaux(波尔多大学拉布里实验室);Université de Bordeaux(波尔多大学);TU Berlin(柏林工业大学);National University of Singapore(新加坡国立大学);Microsoft(微软公司);International Institute of Information Technology Hyderabad(海得拉巴国际信息技术研究所);CEA(法国原子能和替代能源委员会);CNRS(法国国家科学研究中心)
Topographic Constraints Shape Brain-Like Component Structure in Auditory Models
Cognition and Brain Science, School of Psychology, Georgia Tech(认知与脑科学系,心理学学院,佐治亚理工学院);Computational Cognition, Georgia Tech(计算认知学,佐治亚理工学院);Neuroscience Institute and Department of Psychology, Carnegie Mellon University(神经科学研究所和心理学系,卡内基梅隆大学)
Brain-inspired learning in artificial neural networks: a review
Johns Hopkins University(约翰斯·霍普金斯大学);University of Cambridge(剑桥大学);Intel Labs(英特尔实验室);ML Collective(机器学习联盟);The Swiss AI Lab IDSIA(瑞士人工智能实验室IDSIA);University of Maryland, College Park(马里兰大学帕克分校);University of California, Santa Cruz(加州大学圣克鲁兹分校)