arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.04071eess.SPcs.LG
收藏

用于心脏异常检测的生成式预训练Transformer

Generative Pre-Trained Transformer for Cardiac Abnormality Detection

Swiss Center for Electronics and Microtechnology (CSEM SA)(瑞士电子与微技术中心)

Pierre Louis Gaudilliere, Halla Sigurthorsdottir, Clémentine Aguet, Jérôme Van Zaen, Mathieu Lemay, Ricard Delgado-Gonzalo

摘要:

心搏分类在心律失常的诊断中起着至关重要的作用。Physionet/CinC 2021挑战赛的目标是根据12、6、4、3或2导联ECG记录对临床诊断进行准确分类,以帮助医生诊断不同的心脏疾病。Transformers在过去的几年里在自然语言处理领域取得了巨大的成功。我们的团队CinCSEM提出,通过将重复的周期视为单词,将整个信号视为这些单词的序列,来绘制文本和周期时间序列信号之间的平行关系。以这种方式,Transformers的注意力机制可以应用于周期性时间序列信号。在我们的实现中,我们遵循Transformer Encoder架构,该架构将几个编码器层与密集层结合起来,分别用于生成预训练或分类。这里介绍的用例是挑战共享的ECG记录的心跳异常的多标签分类。我们最好的参赛作品,没有超过挑战的硬件限制,分别在12导联、6导联、4导联、3导联和2导联测试集上获得了0.12、0.07、0.10、0.10和0.07的分数。不幸的是,我们的团队无法排名,因为缺少预印。

英文摘要:

ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid doctors in the diagnoses of different heart conditions. Transformers have had great success in the field of natural language processing in the past years. Our team, CinCSEM, proposes to draw the parallel between text and periodic time series signals by viewing the repeated period as words and the whole signal as a sequence of such words. In this way, the attention mechanisms of the transformers can be applied to periodic time series signals. In our implementation, we follow the Transformer Encoder architecture, which combines several encoder layers followed by a dense layer with linear or sigmoid activation for generative pre-training or classification, respectively. The use case presented here is multi-label classification of heartbeat abnormalities of ECG recordings shared by the challenge. Our best entry, not exceeding the challenge's hardware limitations, achieved a score of 0.12, 0.07, 0.10, 0.10 and 0.07 on 12-lead, 6-lead, 4-lead, 3-lead and 2-lead test set respectively. Unfortunately, our team was unable to be ranked because of a missing pre-print.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑