Zero Shot Health Trajectory Prediction Using Transformer
Massachusetts General Hospital(麻省总医院);Harvard Medical School(哈佛医学院);AGH University of Science and Technology(AGH科技大学);Massachusetts Institute of Technology(麻省理工学院);Brigham and Women’s Hospital(布莱根妇女医院);Harvard Chan School of Public Health(哈佛陈曾熙公共卫生学院)
Pawel Renc, Yugang Jia, Anthony E. Samir, Jaroslaw Was, Quanzheng Li, David W. Bates, Arkadiusz Sitek
Integrating modern machine learning and clinical decision-making has great promise for mitigating healthcare's increasing cost and complexity. We introduce the Enhanced Transformer for Health Outcome Simulation (ETHOS), a novel application of the transformer deep-learning architecture for analyzing high-dimensional, heterogeneous, and episodic health data. ETHOS is trained using Patient Health Timelines (PHTs)-detailed, tokenized records of health events-to predict future health trajectories, leveraging a zero-shot learning approach. ETHOS represents a significant advancement in foundation model development for healthcare analytics, eliminating the need for labeled data and model fine-tuning. Its ability to simulate various treatment pathways and consider patient-specific factors positions ETHOS as a tool for care optimization and addressing biases in healthcare delivery. Future developments will expand ETHOS' capabilities to incorporate a wider range of data types and data sources. Our work demonstrates a pathway toward accelerated AI development and deployment in healthcare.
Retrieval-Augmented Interpretable Learning: Towards Task-Specific Zero-Shot Models in Healthcare
Carnegie Mellon University(卡内基梅隆大学);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);GenBio AI(基因生物人工智能公司);Intel(英特尔公司)
Cross-Trajectory Representation Learning for Zero-Shot Generalization in RL
McGill University(麦吉尔大学);Quebec AI Institute(魁北克人工智能研究所);Stanford University(斯坦福大学);Sony AI(索尼人工智能);Université de Montréal(蒙特利尔大学);Microsoft Research(微软研究院);Microsoft(微软)
DT-Transformer: A Foundation Model for Disease Trajectory Prediction on a Real-world Health System
Division of Pharmacoepidemiology and Pharmacoeconomics, Department of Medicine, Brigham and Women’s Hospital, Harvard Medical School(药理流行病学与药效学部,医学部,布里奇沃特医院,哈佛医学院);Harvard T.H. Chan School of Public Health, Harvard University(哈佛大学T.H. 陈公共卫生学院);Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University(自然与人工智能研究学院,哈佛大学);Broad Institute of MIT and Harvard, Cambridge, MA, USA(MIT与哈佛大学Broad研究所,剑桥,马萨诸塞州,美国);Harvard Data Science Initiative, Harvard University(哈佛大学数据科学计划)
HealthSLM-Bench: Benchmarking Small Language Models for Mobile and Wearable Healthcare Monitoring
School of Computing and Information Systems, University of Melbourne, Australia(墨尔本大学计算机与信息系统学院);School of Computer Science, University of Auckland, New Zealand(奥克兰大学计算机科学学院)
Small or Large? Zero-Shot or Finetuned? Guiding Language Model Choice for Specialized Applications in Healthcare
British Columbia Cancer Registry Provincial Health Services Authority(不列颠哥伦比亚省癌症登记处省级卫生服务局);Data Science Institute University of British Columbia(数据科学研究所不列颠哥伦比亚大学)
A Few-shot Learning Graph Multi-Trajectory Evolution Network for Forecasting Multimodal Baby Connectivity Development from a Baseline Timepoint
Istanbul Technical University(伊斯坦布尔技术大学);University of Sousse(苏塞大学);National School for Computer Science (ENSI)(国家计算机科学学校);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);ShanghaiTech University(上海科技大学);United Imaging Intelligence Co., Ltd.(联影智能有限公司)
Prompting Large Language Models for Zero-Shot Clinical Prediction with Structured Longitudinal Electronic Health Record Data
Institute of Artificial Intelligence, Beihang University(北京航空航天大学人工智能研究院);Centre for Medical Informatics, University of Edinburgh(爱丁堡大学医学信息学中心);School of Computing, National University of Singapore(新加坡国立大学计算机学院);National Engineering Research Center for Software Engineering, Peking University(北京大学国家软件工程研究中心);Health Data Research UK(英国健康数据研究中心)
Zero-shot Medical Event Prediction Using a Generative Pre-trained Transformer on Electronic Health Records
Biomedical AI Research Lab, University of California, Los Angeles, Los Angeles, USA(生物医学人工智能研究实验室,加州大学洛杉矶分校);Department of Radiology, University of California, Los Angeles, Los Angeles, USA(放射科,加州大学洛杉矶分校);Department of Bioengineering, University of California, Los Angeles, Los Angeles, USA(生物工程系,加州大学洛杉矶分校);Bioinformatics, University of California, Los Angeles, Los Angeles, USA(生物信息学,加州大学洛杉矶分校);Department of Pediatrics, Division of Immunology, Allergy and Rheumatology, University of California, Los Angeles, Los Angeles, USA(儿科,免疫学、过敏与风湿病学部,加州大学洛杉矶分校);Health Department of Information Services and Solutions, University of California, Los Angeles, University of California, Los Angeles, Los Angeles, USA(信息服务与解决方案健康部门,加州大学洛杉矶分校);Department of Computational Medicine, University of California Los Angeles, Los Angeles, CA, USA(计算医学系,加州大学洛杉矶分校)
LLMs-based Few-Shot Disease Predictions using EHR: A Novel Approach Combining Predictive Agent Reasoning and Critical Agent Instruction
Emory University(埃默里大学);University of Washington(华盛顿大学);UCSD(加利福尼亚大学圣迭戈分校);Rollins School of Public Health, Emory University(埃默里大学罗林斯公共卫生学院);School of Medicine, Emory University(埃默里大学医学院)
Trajectory-guided discharge stratification for heart failure using short-context electronic health record sequence modeling
Sahlgrenska University Hospital(斯德哥尔摩大学医院);Department of Computer Science and Engineering, Chalmers University of Technology and University of Gothenburg(计算机科学与工程系,查尔姆斯理工大学和乌普萨拉大学);Department of Molecular and Clinical Medicine, Sahlgrenska Academy, University of Gothenburg(分子与临床医学系,斯德哥尔摩学院,乌普萨拉大学);Department of Medicine, Geriatrics and Emergency Medicine, Sahlgrenska University Hospital(医学、老年医学和急诊医学系,斯德哥尔摩大学医院);Department of Food and Nutrition, and Sport Science, Faculty of Education, University of Gothenburg(营养学与体育科学系,教育学院,乌普萨拉大学);School of Public Health and Community Medicine, Institute of Medicine, University of Gothenburg(公共卫生与社区医学系,医学院,乌普萨拉大学)
Early Cycle Charge Trajectory Generative Prediction and Full Life Cycle Health Management of Iron-Chromium Flow Batteries Based on FlowBD-E1
State Key Laboratory of Heavy Oil Processing, China University of Petroleum (Beijing)(中国石油大学(北京)重质油国家重点实验室);Zhonghai Energy Storage Technology (Beijing) Co., Ltd.(中海储能科技(北京)有限公司)
MetaSTH-Sleep: Towards Effective Few-Shot Sleep Stage Classification for Health Management with Spatial-Temporal Hypergraph Enhanced Meta-Learning
The First Affiliated Hospital of Zhengzhou University(郑州大学第一附属医院);School of Computer Science and Technology, Tongji University(同济大学计算机科学与技术学院);School of Engineering, Swinburne University of Technology(斯威本科技大学工程学院);Heart Center, Shanghai Tenth People’s Hospital, School of Medicine, Tongji University(同济大学附属第十人民医院心中心);Liver Cancer Institute, Zhongshan Hospital, Key Laboratory of Carcinogenesis and Cancer Invasion, Fudan University(复旦大学中山医院肝癌研究所);School of Computer Science and Artificial Intelligence, Wuhan University of Technology(武汉理工大学计算机科学与人工智能学院);School of Cyber Science and Engineering, Wuhan University(武汉大学网络空间安全学院);Department of Oral and Maxillofacial Head and Neck Oncology, Shanghai Ninth People’s Hospital, Shanghai Jiao Tong University School of Medicine(上海第九人民医院口腔颌面头颈肿瘤科);College of Stomatology, Shanghai Jiao Tong University(上海交通大学口腔医学院);National Center for Stomatology(口腔医学国家中心)
Zero-Shot Transfer Learning for Structural Health Monitoring using Generative Adversarial Networks and Spectral Mapping
University of California, Los Angeles(加州大学洛杉矶分校);University of Vienna(维也纳大学);K. N. Toosi University of Technology(K. N. 图西理工大学);West Virginia University(西弗吉尼亚大学);Qatar University(卡塔尔大学)
Prompting Decision Transformer for Few-Shot Policy Generalization
Carnegie Mellon University(卡内基梅隆大学);University of Montreal(蒙特利尔大学);Mila(米拉);MIT-IBM Watson AI Lab(MIT-IBM沃森人工智能实验室);Massachusetts Institute of Technology(麻省理工学院);UMass Amherst(马萨诸塞大学阿默斯特分校)
Dist Loss: Enhancing Regression in Few-Shot Region through Distribution Distance Constraint
Institute of Medical Technology, Health Science Center of Peking University(北京大学健康科学中心医学技术研究所);National Institute of Health Data Science, Peking University(北京大学国家健康数据科学研究院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
Multi-Modal Zero-Shot Prediction of Color Trajectories in Food Drying
Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign, Urbana, IL, USA(机械科学与工程系,伊利诺伊大学厄巴纳-香槟分校);Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, USA(机械工程系,密歇根大学安娜堡分校)
COVID-Net USPro: An Open-Source Explainable Few-Shot Deep Prototypical Network to Monitor and Detect COVID-19 Infection from Point-of-Care Ultrasound Images
University of Waterloo(滑铁卢大学);National Research Council Canada(加拿大国家研究委员会);McGill University(麦吉尔大学)