One way to extract patterns from clinical records is to consider each patient record as a bag with various number of instances in the form of symptoms. Medical diagnosis is to discover informative ones first and then map them to one or more diseases. In many cases, patients are represented as vectors in some feature space and a classifier is applied after to generate diagnosis results. However, in many real-world cases, data is often of low-quality due to a variety of reasons, such as data consistency, integrity, completeness, accuracy, etc. In this paper, we propose a novel approach, attention based multi-instance neural network (AMI-Net), to make the single disease classification only based on the existing and valid information in the real-world outpatient records. In the context of a patient, it takes a bag of instances as input and output the bag label directly in end-to-end way. Embedding layer is adopted at the beginning, mapping instances into an embedding space which represents the individual patient condition. The correlations among instances and their importance for the final classification are captured by multi-head attention transformer, instance-level multi-instance pooling and bag-level multi-instance pooling. The proposed approach was test on two non-standardized and highly imbalanced datasets, one in the Traditional Chinese Medicine (TCM) domain and the other in the Western Medicine (WM) domain. Our preliminary results show that the proposed approach outperforms all baselines results by a significant margin.
Clinical Assistant Diagnosis for Electronic Medical Record Based on Convolutional Neural Network
Tsinghua University(清华大学);Tsinghua National Laboratory of Information Science and Technology(清华信息科学与技术国家实验室);Beijing University of Posts and Telecommunications(北京邮电大学);Huangshi Central Hospital of Edong Healthcare Group, Hubei Polytechnic University(湖北理工学院鄂东医疗集团黄石市中心医院)
Gradient Boosting Decision Trees on Medical Diagnosis over Tabular Data
Department of Electrical and Computer Engineering(电气与计算机工程系);Northeastern University(东北大学);The Business School(商学院);Worcester Polytechnic Institute(沃思利理工学院)
A ChatGPT Aided Explainable Framework for Zero-Shot Medical Image Diagnosis
Zhejiang University-University of Illinois at Urbana-Champaign Institute(浙江大学伊利诺伊大学厄巴纳香槟校区联合学院);Zhejiang University(浙江大学);National University of Singapore(新加坡国立大学);Angelalign Inc.(时代天使公司)
Fusing Medical Image Features and Clinical Features with Deep Learning for Computer-Aided Diagnosis
Beijing Institute of Technology(北京理工大学);Xuanwu Hospital, Capital Medical University(首都医科大学宣武医院);National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College(中国医学科学院北京协和医学院肿瘤医院(国家癌症中心/国家肿瘤临床医学研究中心))
Diagnosing Shoulder Disorders Using Multimodal Large Language Models and Consumer-Grade Cameras
Bytedance(字节跳动);Peking University(北京大学);Peking University People’s Hospital(北京大学人民医院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);The Chinese University of Hong Kong(香港中文大学)
ActiveMedAgent: Cost-Aware Trajectory Learning for Multimodal Medical Diagnosis
Washington University in St. Louis(圣路易斯华盛顿大学);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院);Arizona State University(亚利桑那州立大学);Yale University(耶鲁大学);Amazon(亚马逊公司)
Medical Diagnosis with Large Scale Multimodal Transformers: Leveraging Diverse Data for More Accurate Diagnosis
University Hospital Aachen(亚琛大学医院);RWTH Aachen University(亚琛工业大学);Ocumeda GmbH(Ocumeda 有限公司);RWTH Aachen(亚琛工业大学);Charité – Universitätsmedizin Berlin(柏林夏里特医学院);Freie Universität Berlin(柏林自由大学);Technical University Dresden(德累斯顿工业大学);University of Leeds(利兹大学);University Hospital Heidelberg(海德堡大学医院)
DeltaNet:Conditional Medical Report Generation for COVID-19 Diagnosis
Tencent Jarvis Lab(腾讯Jarvis实验室);Institute of Computing Technology Chinese Academy of Sciences(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);The First Affiliated Hospital of Anhui Medical University(安徽医科大学第一附属医院);University of Science and Technology of China(中国科学技术大学)
Unimodal-uniform Constrained Wasserstein Training for Medical Diagnosis
BIDMC(贝斯以色列女执事医疗中心);Harvard Medical School(哈佛医学院);Carnegie Mellon University(卡内基梅隆大学);Johns Hopkins University(约翰斯·霍普金斯大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Random Token Fusion for Multi-View Medical Diagnosis
KTH Royal Institute of Technology(皇家理工学院);Science for Life Laboratory(生命科学实验室);Karolinska Institutet(卡罗林斯卡学院);Karolinska University Hospital(卡罗林斯卡大学医院)
Rethinking Human-AI Collaboration in Complex Medical Decision Making: A Case Study in Sepsis Diagnosis
Northeastern University(东北大学);Massachusetts Institute of Technology(麻省理工学院);The Ohio State University(俄亥俄州立大学);Rensselaer Polytechnic Institute(伦斯勒理工学院);The Ohio State University Wexner Medical Center(俄亥俄州立大学韦克斯纳医学中心)
Medical Multimodal Foundation Models in Clinical Diagnosis and Treatment: Applications, Challenges, and Future Directions
School of Biomedical Engineering, Tsinghua University(清华大学生物医学工程学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系);Hepato-Pancreato-Biliary Center, Beijing Tsinghua Changgung Hospital, School of Clinical Medicine, Tsinghua University(清华大学临床医学院北京清华长庚医院肝胆胰中心);School of Computer and Communication Engineering, University of Science and Technology Beijing(北京科技大学计算机与通信工程学院);College of Electronic Information Engineering, Tongji University(同济大学电子与信息工程学院)
Subtype-aware Unsupervised Domain Adaptation for Medical Diagnosis
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);Beth Israel Deaconess Medical Center(贝斯以色列女执事医疗中心);Nankai University(南开大学);The Hong Kong Polytechnic University(香港理工大学);University of Southern California(南加州大学);China University of Mining and Technology(中国矿业大学);Beijing University of Posts and Telecommunications(北京邮电大学)
Improving ECG-based COVID-19 diagnosis and mortality predictions using pre-pandemic medical records at population-scale
Canadian VIGOUR Centre, University of Alberta(阿尔伯塔大学加拿大VIGOUR中心);University of Alberta(阿尔伯塔大学);Alberta Health Services(阿尔伯塔卫生服务局);Alberta Machine Intelligence Institute(阿尔伯塔机器智能研究所)