Learning Large Margin Sparse Embeddings for Open Set Medical Diagnosis
Beihang University(北京航空航天大学);School of Biological Science and Medical Engineering(生物与医学工程学院);Hefei Innovation Research Institute, Beihang University(北京航空航天大学合肥创新研究院)
在深度学习的推动下,计算机辅助诊断取得了巨大进展。然而,在受控实验室环境之外,算法可能面临多重挑战。开放集识别(Open Set Recognition, OSR)便是其中一项重要挑战,其核心问题是测试阶段可能出现训练过程中未见过的类别。在医疗领域,这一问题可能源于训练数据集收集不完整,以及不断出现的新型或罕见疾病。开放集识别要求算法不仅能正确分类已知类别,还能识别未知类别并将其提交给专家做进一步诊断。\n为解决开放集识别问题,我们假设已知类别会密集占据嵌入空间的小部分区域,而其余稀疏区域可被识别为未知类别。基于这一假设,我们提出了融合两种机制的Open Margin Cosine Loss(OMCL,开放间隔余弦损失)。第一种机制名为Margin Loss with Adaptive Scale(MLAS,自适应尺度间隔损失),通过引入角度间隔增强类内紧凑性与类间可分性,并搭配自适应缩放因子提升泛化能力;第二种机制名为Open-Space Suppression(OSS,开放空间抑制),利用提出的特征空间描述符将稀疏嵌入空间识别为未知类别,从而实现分类器的开放化。\n此外,由于医疗领域的开放集识别仍处于起步阶段,我们提出了两个公开基准数据集用于方法对比。大量消融实验和特征可视化结果验证了各设计模块的有效性。与当前最优方法相比,MLAS在ACC(准确率)、AUROC(受试者工作特征曲线下面积)和OSCR(开放集分类率)指标上均取得了更优性能。
英文摘要:
Fueled by deep learning, computer-aided diagnosis achieves huge advances. However, out of controlled lab environments, algorithms could face multiple challenges. Open set recognition (OSR), as an important one, states that categories unseen in training could appear in testing. In medical fields, it could derive from incompletely collected training datasets and the constantly emerging new or rare diseases. OSR requires an algorithm to not only correctly classify known classes, but also recognize unknown classes and forward them to experts for further diagnosis. To tackle OSR, we assume that known classes could densely occupy small parts of the embedding space and the remaining sparse regions could be recognized as unknowns. Following it, we propose Open Margin Cosine Loss (OMCL) unifying two mechanisms. The former, called Margin Loss with Adaptive Scale (MLAS), introduces angular margin for reinforcing intra-class compactness and inter-class separability, together with an adaptive scaling factor to strengthen the generalization capacity. The latter, called Open-Space Suppression (OSS), opens the classifier by recognizing sparse embedding space as unknowns using proposed feature space descriptors. Besides, since medical OSR is still a nascent field, two publicly available benchmark datasets are proposed for comparison. Extensive ablation studies and feature visualization demonstrate the effectiveness of each design. Compared with state-of-the-art methods, MLAS achieves superior performances, measured by ACC, AUROC, and OSCR.
Subtype-aware Unsupervised Domain Adaptation for Medical Diagnosis
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心);Nankai University(南开大学);The Hong Kong Polytechnic University(香港理工大学);University of Southern California(南加州大学);China University of Mining and Technology(中国矿业大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis
Hong Kong University of Science and Technology(香港科技大学);Department of Computer Science and Engineering(计算机科学与工程系);Department of Chemical and Biological Engineering(化学与生物工程系);Division of Life Science(生命科学部)
A Model for Medical Diagnosis Based on Plantar Pressure
School of Electronics Engineering and Computer Science Peking University(北京大学电子工程与计算机科学学院);Institute of Sports Medicine Peking University Third Hospital(北京大学第三医院运动医学研究所)
Random Token Fusion for Multi-View Medical Diagnosis
KTH Royal Institute of Technology(皇家理工学院);Science for Life Laboratory(生命科学实验室);Karolinska Institutet(卡罗林斯卡学院);Karolinska University Hospital(卡罗林斯卡大学医院)
See-in-Pairs: Reference Image-Guided Comparative Vision-Language Models for Medical Diagnosis
Electrical and Computer Engineering Department, The University of British Columbia(不列颠哥伦比亚大学电气与计算机工程系);Vector Institute(向量研究所);ETH Zurich(苏黎世联邦理工学院);Renmin University of China(中国人民大学);National University of Singapore(新加坡国立大学)
SMFusion: Semantic-Preserving Fusion of Multimodal Medical Images for Enhanced Clinical Diagnosis
College of Information and Intelligence, Hunan Agricultural University(湖南农业大学信息与智能学院);College of Artificial Intelligence, Nankai University(南开大学人工智能学院)
Ontology-based knowledge representation for bone disease diagnosis: a foundation for safe and sustainable medical artificial intelligence systems
University of Science, VNUHCM(胡志明市国家大学科学大学);Viet Nam National University, Ho Chi Minh City(越南国家大学胡志明市分校);Ho Chi Minh City Hospital for Traumatology and Orthopedics(胡志明市创伤与骨科医院)
Federated Distillation for Medical Image Classification: Towards Trustworthy Computer-Aided Diagnosis
School of Information and Communication Engineering, Hainan University(海南大学信息与通信工程学院);College of Mathematical Sciences, BoHai University(渤海大学数学科学学院);Australian AI Institute, University of Technology Sydney(悉尼科技大学澳大利亚人工智能研究所);School of Electronic Science and Technology, Hainan University(海南大学电子科学与技术学院)
Key Patches Are All You Need: A Multiple Instance Learning Framework For Robust Medical Diagnosis
Institute for Systems and Robotics(系统与机器人研究所);Instituto Superior Técnico(里斯本高等理工学院);Institute of Computing(计算研究所);University of Campinas(坎皮纳斯大学);Lisbon ELLIS Unit(里斯本ELLIS单元)
Mining Gaze for Contrastive Learning toward Computer-Assisted Diagnosis
School of Biomedical Engineering, Shanghai Jiao Tong University(上海交通大学生物医学工程学院);Shanghai United Imaging Intelligence Co., Ltd.(上海联影智能医疗科技有限公司);Shanghai Clinical Research and Trial Center(上海临床研究与试验中心)
A Clinical-oriented Multi-level Contrastive Learning Method for Disease Diagnosis in Low-quality Medical Images
Northeastern University(东北大学);Key Laboratory of Intelligent Computing in Medical Image of Ministry of Education(医学图像智能计算教育部重点实验室);National Frontiers Science Center for Industrial Intelligence and Systems Optimization(工业智能与系统优化全国前沿科学中心)
DDX-TRACE: A Benchmark for Medical Diagnostic Trajectories in VLMs
Technical University of Munich(慕尼黑技术大学);TUM University Hospital(TUM大学医院);Munich Center for Machine Learning(慕尼黑机器学习中心);LMU Munich(慕尼黑大学);Aalto University(阿尔托大学);Imperial College London(伦敦帝国学院)
A ChatGPT Aided Explainable Framework for Zero-Shot Medical Image Diagnosis
Zhejiang University-University of Illinois at Urbana-Champaign Institute(浙江大学伊利诺伊大学厄巴纳香槟校区联合学院);Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);Angelalign Inc.(时代天使公司)
Fusing Medical Image Features and Clinical Features with Deep Learning for Computer-Aided Diagnosis
Beijing Institute of Technology(北京理工大学);Xuanwu Hospital, Capital Medical University(首都医科大学宣武医院);National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院北京协和医学院肿瘤医院(国家癌症中心/国家肿瘤临床医学研究中心))