Reinforcement learning (RL) is a type of artificial intelligence for making optimal choices. In healthcare, researchers generally use offline RL (ORL), where models are trained and evaluated from retrospective observational data. To accommodate naturally irregular clinical records, researchers often resample the data into uniform time intervals before training (known as binning). However, binning may create counterfactual trajectories that do not represent clinical practice. We first quantified these distortions in patients receiving continuous insulin infusions in the MIMIC-IV intensive care database. Binning reversed the apparent causal order for over 70% of paired glucose measurements and insulin adjustments within the same interval, and frequently masked significant dysglycaemic events and merged distinct treatment decisions together. We then conducted an in silico clinical trial using 30 virtual patients with type 1 diabetes from the FDA-approved UVA/Padova simulator. The simulator was modified to include stochastic intervals between decisions and used to generate a training dataset for offline RL. We trained three ORL algorithms on both the unprocessed dataset and equivalent datasets resampled at 10-minute, 2-hour, and 4-hour intervals. When deployed back into the simulated environment, temporal resampling was found to reduce model performance by up to 60% relative to unprocessed data, with 4-hour binning causing all agents to perform worse than the dataset's baseline. Retrospective evaluation on resampled data actively obscured this effect, predicting 1.5-3x better returns than agents achieved in practice. We recommend that future research in this area prioritises datasets with natural clinical timings between decisions, which may be a necessary step before these models can be safely deployed into patient care.
Monitoring Fidelity of Online Reinforcement Learning Algorithms in Clinical Trials
School of Engineering and Applied Sciences(工程与应用科学学院);Harvard University(哈佛大学);Graduate School of Business(商学院);Columbia University(哥伦比亚大学);Institute for Social Research(社会研究所);University of Michigan(密歇根大学);Schools of Dentistry & Engineering(牙科学院与工程学院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校)
Advancing clinical trial outcomes using deep learning and predictive modelling: bridging precision medicine and patient-centered care
Luddy School of Informatics, Computing and Engineering, IU Indianapolis(印第安纳大学印第安纳波利斯分校拉迪信息学、计算与工程学院);New York Medical College(纽约医学院);University of North Carolina Greensboro(北卡罗来纳大学格林斯伯勒分校)
Retrieval-Reasoning Large Language Model-based Synthetic Clinical Trial Generation
Institute for Clarity in Documentation(清晰文档研究所);Inria Paris-Rocquencourt(巴黎- Rocquencourt 国家信息与自动化研究所);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕勒实验室);University of Chicago(芝加哥大学);Stanford University(斯坦福大学);Purdue University(普渡大学);University of Southern California(南加州大学)
Multi-disciplinary fairness considerations in machine learning for clinical trials
University of Cambridge(剑桥大学);MRC Biostatistics Unit, University of Cambridge(剑桥大学医学研究委员会生物统计组);Sapienza University of Rome(罗马第一大学);The Alan Turing Institute(阿兰·图灵研究所);Technical University of Munich(慕尼黑工业大学);Helmholtz Munich(亥姆霍兹慕尼黑中心)
Scaling Clinical Trial Matching Using Large Language Models: A Case Study in Oncology
Microsoft Research(微软研究院);Providence Health & Services(普罗维登斯医疗服务机构);Earle A. Chiles Research Institute(厄尔·A·奇尔斯研究所);Providence Cancer Institute(普罗维登斯癌症研究所)
AI Thrust, Information Hub, HKUST(GZ)(香港科技大学(广州)人工智能 thrust 与信息中心);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);School of Computer Science and Engineering, South China University of Technology(华南理工大学计算机科学与工程学院);School of Medicine, Stanford University(斯坦福大学医学院);Computer Science Department, UIUC(伊利诺伊大学厄巴纳-香槟分校计算机科学系);Medical Big Data Center, Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences), Southern Medical University(广东省人民医院(广东省医学科学院)医学大数据中心,南方医科大学);Innovation Institute for Artificial Intelligence in Medicine of Zhejiang University, College of Pharmaceutical Sciences, Zhejiang University(浙江大学人工智能医学创新研究院,浙江大学药学院);The Second Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第二医院);GE HealthCare(通用电气医疗);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);IQVIA;Computer Science Department, Stanford University(斯坦福大学计算机科学系);Informatics, Harvard Medical School, Harvard University(哈佛医学院,哈佛大学informatics部门);State Key Laboratory for Novel Software Technology at Nanjing University, School of Computer Science, Nanjing University(南京大学新型软件技术国家重点实验室,南京大学计算机科学学院)
TrialMatchAI: An End-to-End AI-powered Clinical Trial Recommendation System to Streamline Patient-to-Trial Matching
University of Bordeaux(波尔多大学);CNRS(法国国家科学研究中心);Oslo University Hospital(奥斯陆大学医院);University of Oslo(奥斯陆大学);The Netherlands Cancer Institute(荷兰癌症研究所);University of Vic - Central University of Catalonia(维克大学-加泰罗尼亚中央大学);European Clinical Research Infrastructure Network (ECRIN)(欧洲临床研究基础设施网络)
Language Interaction Network for Clinical Trial Approval Estimation
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Rensselaer Polytechnic Institute(伦斯勒理工学院);Carle Illinois College of Medicine, University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校卡尔伊利诺伊医学院)
TWIN-GPT: Digital Twins for Clinical Trials via Large Language Model
School of Public Health, Zhejiang University(浙江大学公共卫生学院);Rensselaer Polytechnic Institute(伦斯勒理工学院);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
A Latent Risk-Aware Machine Learning Approach for Predicting Operational Success in Clinical Trials based on TrialsBank
Groupe Sorintellis Inc.(索林特利斯集团);Department of Computer Science and Operations Research, Université de Montréal(蒙特利尔大学计算机科学与运筹学系);Department of Computer Engineering, École Polytechnique de Montréal(蒙特利尔理工学院计算机工程系);Faculty of Pharmacy, Université de Montréal(蒙特利尔大学药学院);Faculty of Pharmacy, Université Laval(拉瓦尔大学药学院);Vantage BioTrials(Vantage BioTrials公司);CDS monitoring(CDS监测公司);Department of Social and Preventive Medicine, School of Public Health, Université de Montréal(蒙特利尔大学公共卫生学院社会与预防医学系);Department of Epidemiology, Biostatistics and Occupational Health, McGill University(麦吉尔大学流行病学、生物统计学与职业健康系)