arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.11517q-bio.NCcs.HC
收藏

无共享刺激下的个体间与站点间神经代码转换

Inter-individual and inter-site neural code conversion without shared stimuli

Haibao Wang, Jun Kai Ho, Fan L. Cheng, Shuntaro C. Aoki, Yusuke Muraki, Misato Tanaka, Yukiyasu Kamitani

AI总结:

本文提出一种无需共享刺激的神经代码转换方法,通过优化刺激内容差异并结合DNN层次特征,实现跨个体、跨站点的脑活动转换与高质量视觉重建。

摘要:

精细功能脑组织中的个体间差异给可扩展的数据分析和建模带来了挑战。功能对齐技术可以帮助缓解这些个体差异,但通常需要个体之间具有相同刺激的配对脑数据,而这往往难以获得。我们提出了一种神经代码转换方法,通过基于原始脑活动模式与转换后脑活动模式所表征的刺激内容之间的差异来优化转换参数,从而克服了这一限制。该方法结合深度神经网络(DNN)的层次特征作为潜在内容表征,实现了与使用共享刺激的方法相当的转换精度。来自源被试的转换后脑活动可以利用目标被试的预训练解码器被准确解码,生成高质量的视觉图像重建,其效果可与个体内解码相媲美,即使数据来自不同站点且训练样本有限。我们的方法为可扩展的神经数据分析和建模提供了一个有前景的框架,并为脑对脑通信奠定了基础。

英文摘要:

Inter-individual variability in fine-grained functional brain organization poses challenges for scalable data analysis and modeling. Functional alignment techniques can help mitigate these individual differences but typically require paired brain data with the same stimuli between individuals, which is often unavailable. We present a neural code conversion method that overcomes this constraint by optimizing conversion parameters based on the discrepancy between the stimulus contents represented by original and converted brain activity patterns. This approach, combined with hierarchical features of deep neural networks (DNNs) as latent content representations, achieves conversion accuracy comparable to methods using shared stimuli. The converted brain activity from a source subject can be accurately decoded using the target's pre-trained decoders, producing high-quality visual image reconstructions that rival within-individual decoding, even with data across different sites and limited training samples. Our approach offers a promising framework for scalable neural data analysis and modeling and a foundation for brain-to-brain communication.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑