arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.17844cs.HCcs.AIcs.LG
收藏

RAICL:基于视觉-语言模型的EEG癫痫检测的检索增强上下文学习

RAICL: Retrieval-Augmented In-Context Learning for Vision-Language-Model Based EEG Seizure Detection

Ministry of Education Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(教育部图像处理与智能控制重点实验室,人工智能与自动化学院,华中科技大学);State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences(脑认知与脑启发智能技术国家重点实验室,自动化研究所,中国科学院)

Siyang Li, Zhuoya Wang, Xiyan Gui, Xiaoqing Chen, Ziwei Wang, Yaozhi Wen, Dongrui Wu

AI总结:

RAICL通过利用视觉-语言模型分析EEG波形图,实现了更高效的癫痫检测,无需重新训练,具有广泛临床应用前景。

摘要:

脑电图(EEG)解码是医学诊断、康复工程和脑机接口中的关键组成部分。然而,当前的解码方法仍然严重依赖于任务特定的数据集来训练专门的神经网络架构。因此,有限的数据可用性阻碍了通用大型脑解码模型的发展。在本工作中,我们提出了一种从传统信号解码向基于大规模视觉-语言模型(VLMs)分析EEG波形图的范式转变。通过将多变量EEG信号转换为堆叠的波形图像,并将神经科学领域专业知识融入文本提示中,我们证明基础VLMs能够有效区分人类大脑的不同模式。为了解决EEG信号固有的非平稳性,我们引入了一种检索增强上下文学习(RAICL)方法,该方法动态选择最具有代表性和相关性的少量示例来调节VLM的自回归输出。在基于EEG的癫痫检测实验中,最先进的VLMs在RAICL下实现了比传统时间序列方法更好或相当的性能。这些发现表明,生理信号处理的新方向有效连接了视觉、语言和神经活动的模态。此外,利用现成的VLMs,无需重新训练或下游架构构建,为临床应用提供了一种易于部署的解决方案。

英文摘要:

Electroencephalogram (EEG) decoding is a critical component of medical diagnostics, rehabilitation engineering, and brain-computer interfaces. However, contemporary decoding methodologies remain heavily dependent on task-specific datasets to train specialized neural network architectures. Consequently, limited data availability impedes the development of generalizable large brain decoding models. In this work, we propose a paradigm shift from conventional signal-based decoding by leveraging large-scale vision-language models (VLMs) to analyze EEG waveform plots. By converting multivariate EEG signals into stacked waveform images and integrating neuroscience domain expertise into textual prompts, we demonstrate that foundational VLMs can effectively differentiate between different patterns in the human brain. To address the inherent non-stationarity of EEG signals, we introduce a Retrieval-Augmented In-Context Learning (RAICL) approach, which dynamically selects the most representative and relevant few-shot examples to condition the autoregressive outputs of the VLM. Experiments on EEG-based seizure detection indicate that state-of-the-art VLMs under RAICL achieved better or comparable performance with traditional time series based approaches. These findings suggest a new direction in physiological signal processing that effectively bridges the modalities of vision, language, and neural activities. Furthermore, the utilization of off-the-shelf VLMs, without the need for retraining or downstream architecture construction, offers a readily deployable solution for clinical applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑