Study Objectives: Inter-scorer variability in scoring polysomnograms is a well-known problem. Most of the existing automated sleep scoring systems are trained using labels annotated by a single scorer, whose subjective evaluation is transferred to the model. When annotations from two or more scorers are available, the scoring models are usually trained on the scorer consensus. The averaged scorer's subjectivity is transferred into the model, losing information about the internal variability among different scorers. In this study, we aim to insert the multiple-knowledge of the different physicians into the training procedure. The goal is to optimize a model training, exploiting the full information that can be extracted from the consensus of a group of scorers.
Methods: We train two lightweight deep learning based models on three different multi-scored databases. We exploit the label smoothing technique together with a soft-consensus (LSSC) distribution to insert the multiple-knowledge in the training procedure of the model. We introduce the averaged cosine similarity metric (ACS) to quantify the similarity between the hypnodensity-graph generated by the models with-LSSC and the hypnodensity-graph generated by the scorer consensus.
Results: The performance of the models improves on all the databases when we train the models with our LSSC. We found an increase in ACS (up to 6.4%) between the hypnodensity-graph generated by the models trained with-LSSC and the hypnodensity-graph generated by the consensus.
Conclusion: Our approach definitely enables a model to better adapt to the consensus of the group of scorers. Future work will focus on further investigations on different scoring architectures and hopefully large-scale-heterogeneous multi-scored datasets.
Dreem Open Datasets: Multi-Scored Sleep Datasets to compare Human and Automated sleep staging
Dreem(Dreem公司);Stanford University(斯坦福大学);French Armed Forces Biomedical Research Institute (IRBA)(法国武装部队生物医学研究所(IRBA));Paris Descartes University(巴黎笛卡尔大学)
ULW-SleepNet: An Ultra-Lightweight Network for Multimodal Sleep Stage Scoring
School of Computer Science and Technology, Dalian University of Technology(大连理工大学计算机科学与技术学院);Faculty of Information Technology, University of Jyväskylä(于韦斯屈莱大学信息科技学院);Key Laboratory of Social Computing and Cognitive Intelligence, Ministry of Education(教育部社会计算与认知智能重点实验室);School of Biomedical Engineering, Faculty of Medicine, Dalian University of Technology(大连理工大学生物医学工程学院);Department of Computing Sciences, Tampere University(塔尔库大学计算机科学系);Faculty of Medicine, University of Helsinki(赫尔辛基大学医学学院)
Automated Classification of Sleep Stages and EEG Artifacts in Mice with Deep Learning
Emory University(埃默里大学);University Hospital Tübingen(图宾根大学医院);University of Tübingen(图宾根大学);Technische Universität Dresden(德累斯顿工业大学);German Center for Neurodegenerative Diseases (DZNE)(德国神经退行性疾病中心);FH Aachen University of Applied Sciences(亚琛应用技术大学)
Addressing database variability in learning from medical data: an ensemble-based approach using convolutional neural networks and a case of study applied to automatic sleep scoring
Haaglanden Medisch Centrum(哈格兰登医疗中心);University of A Coruña(拉科鲁尼亚大学)
Bridging AI and Clinical Practice: Integrating Automated Sleep Scoring Algorithm with Uncertainty-Guided Physician Review
University of Bern(伯尔尼大学);University of Applied Sciences and Arts of Southern Switzerland(瑞士南部应用科学与艺术大学);Inselspital, Bern University Hospital(伯尔尼大学医院);Ohio Sleep Medicine Institute(俄亥俄睡眠医学研究所)
EEG Sleep Stage Classification with Continuous Wavelet Transform and Deep Learning
University of Applied Science and Technology(应用科技大学);MZG Consulting(MZG咨询公司);Institute of Electrical and Electronics Engineers(电气与电子工程师协会);Baku State University(巴库国立大学)
Convolutional Neural Networks for Sleep Stage Scoring on a Two-Channel EEG Signal
University of A Coruna(拉科鲁尼亚大学);Instituto de Investigacion Biomedica de A Coruña (INIBIC)(拉科鲁尼亚生物医学研究所);Complexo Hospitalario Universitario de A Coruña (CHUAC)(拉科鲁尼亚大学医院)
ProductGraphSleepNet: Sleep Staging using Product Spatio-Temporal Graph Learning with Attentive Temporal Aggregation
Sharif University of Technology(谢里夫理工大学);Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Georgia Institute of Technology(佐治亚理工学院);Emory School of Medicine(埃默里大学医学院)
AnySleep: a channel-agnostic deep learning system for high-resolution sleep staging in multi-center cohorts
Department of Medical Engineering and Technomathematics, FH Aachen University of Applied Sciences(医学工程与技术学系,亚琛应用科学大学);Department of Information and Computing Sciences, Utrecht University(信息与计算科学系,乌得勒支大学);Institute for Data-Driven Technologies, FH Aachen University of Applied Sciences(数据驱动技术研究所,亚琛应用科学大学)
Fully-automated sleep staging: multicenter validation of a generalizable deep neural network for Parkinson's disease and isolated REM sleep behavior disorder
Aarhus University(奥胡斯大学);Aarhus University Hospital(奥胡斯大学医院);Lundbeck Foundation Parkinson’s Disease Research Center (PACE)(伦德贝克基金会帕金森病研究中心(PACE));University of Cologne(科隆大学);University Hospital Cologne(科隆大学医院);Institute for Biomedical Informatics, Faculty of Medicine and University Hospital Cologne(科隆大学医学院暨科隆大学医院生物医学信息学研究所);Center for Molecular Medicine Cologne (CMMC), Faculty of Medicine and University Hospital Cologne(科隆大学医学院暨科隆大学医院科隆分子医学中心(CMMC));Research Center Juelich(于利希研究中心);University of Bonn(波恩大学);University Hospital Bonn(波恩大学医院);German Center for Neurodegenerative Diseases (DZNE)(德国神经退行性疾病中心(DZNE));Glostrup University Hospital(格洛斯楚普大学医院);Danish Center for Sleep Medicine(丹麦睡眠医学中心)
MSA-CNN: A Lightweight Multi-Scale CNN with Attention for Sleep Stage Classification
Centre for Computational Science and Mathematical Modelling, Coventry University(计算科学与数学建模中心,科文大学);Institute for Infocomm Research, A*STAR(信息通信研究所,A*STAR)
Confusion-Aware Transfer Teacher Curriculum Learning Framework: Disentangling Scoring and Pacing Effects
Faculty of Computing, Sri Lanka Institute of Information Technology, Sri Lanka(斯里兰卡信息科技学院计算机学院,斯里兰卡);Faculty of Engineering, University of Sri Jayewardenepura, Sri Lanka(斯里兰卡贾亚韦达内普拉大学工程学院,斯里兰卡);Faculty of Engineering, Sri Lanka Institute of Information Technology, Sri Lanka(斯里兰卡信息科技学院工程学院,斯里兰卡);University of Sheffield, United Kingdom(谢菲尔德大学,英国);Utrecht University, The Netherlands(乌得勒支大学,荷兰)