Photoplethysmography (PPG) is increasingly recorded by wearable and clinical devices at enormous scale, and a growing number of PPG foundation models (FMs) have been developed to compute reusable representations for various downstream tasks. These models are difficult to compare: different evaluations use different datasets, task definitions, preprocessing, downstream heads, hyperparameter tuning, and baselines. We present PPG-Bench, a unifying open-source benchmark evaluating five public PPG FMs across nine open-access datasets and 26 tasks spanning cardiovascular state estimation, activity, sleep, screening, and identification. We evaluate models under four downstream regimes of increasing adaptability (linear probing, random forests, frozen MLP probes, and end-to-end finetuning), with model-specific hyperparameter optimization and subject-disjoint cross-validation. We also evaluate against three controls: random/constant baseline, a deterministic pulse-rate-variability (PRV) feature set, and a generic time-series FM (MOMENT). Across all 68 task-regime combinations, 35.3% show no meaningful FM advantage over the random/constant baseline, and in 83.8% no PPG-specific FM outperforms both PRV and MOMENT. We also find that added downstream head capacity generally improves performance, but can cause significant degradation if the model is performing at chance/constant level. Current PPG FMs therefore cannot yet claim to provide generalised and transferrable representations of PPG signals, and future evaluation in this field should include checks against simple, non-learned controls. Code for the benchmark and instructions to evaluate more models can be found here - https://github.com/mannas-ai/ppg-bench.
Deriving Health Metrics from the Photoplethysmogram: Benchmarks and Insights from MIMIC-III-Ext-PPG
AI4Health Department, Oldenburg University(AI4Health部门,旧恩斯特堡大学);Department of Data Science and AI, National Physical Laboratory(数据科学与人工智能系,国家物理实验室);School of Mathematics and Physics, University of Surrey(数学与物理学院,萨里大学);Department of Public Health and Primary Care, University of Cambridge(公共卫生与初级保健系,剑桥大学)
Benchmarking and Enhancing PPG-Based Cuffless Blood Pressure Estimation Methods
Department of Engineering Technology, University of Houston, Texas, USA(工程科技系,休斯顿大学,德克萨斯州,美国);Department of Electrical and Computer Engineering, University of Houston, Texas, USA(电气与计算机工程系,休斯顿大学,德克萨斯州,美国);Department of Information Science Technology, University of Houston, Texas, USA(信息科学科技系,休斯顿大学,德克萨斯州,美国);Department of Cardiovascular Surgery, Houston Methodist Hospital, Texas, USA(心血管外科系,休斯顿方法医院,德克萨斯州,美国);Department of Biomedical Engineering, University of Houston, Texas, USA(生物医学工程系,休斯顿大学,德克萨斯州,美国)
Benchmark Problems and Benchmark Datasets for the evaluation of Machine and Deep Learning methods on Photoplethysmography signals: the D4 report from the QUMPHY project
Technische Hochschule Mittelhessen - University of Applied Sciences(米特黑森应用技术大学);National Physical Laboratory(国家物理实验室);University of Cambridge(剑桥大学);Physikalisch-Technische Bundesanstalt(德国联邦物理技术研究院);Kaunas University of Technology(考纳斯理工大学);Carl von Ossietzky Universität Oldenburg(奥尔登堡大学)
PPG-Distill: Efficient Photoplethysmography Signals Analysis via Foundation Model Distillation
Department of Computer Science, Emory University(计算机科学系,埃默里大学);Nell Hodgson Woodruff School of Nursing, Emory University(Nell Hodgson Woodruff护理学院,埃默里大学)
Continuous Cardiac Arrest Prediction in ICU using PPG Foundation Model
Nell Hodgson Woodruff School of Nursing, Emory University(埃默里大学内尔·霍奇森·伍德拉夫护理学院);Nihon Kohden Digital Health Solutions, Inc(光电数字健康解决方案公司);University of California, San Francisco(加州大学旧金山分校);Children’s Healthcare of Atlanta(亚特兰大儿童医疗保健系统)
SIGMA-PPG: Statistical-prior Informed Generative Masking Architecture for PPG Foundation Model
Department of Electronics, Information and Bioengineering, Politecnico di Milano(电子工程与信息生物工程系,米兰理工大学);State Key Laboratory of Industrial Control Technology, Zhejiang University(工业控制技术国家重点实验室,浙江大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院);Nell Hodgson Woodruff School of Nursing, Emory University(埃默里大学护理学院)
GPT-PPG: A GPT-based Foundation Model for Photoplethysmography Signals
Emory University(埃默里大学);Georgia Institute of Technology(佐治亚理工学院);Nell Hodgson Woodruff School of Nursing, Emory University(埃默里大学内尔·霍奇森·伍德拉夫护理学院);University of California San Francisco(加利福尼亚大学旧金山分校)
Benchmarking Generalist and Specialist Time-Series Foundation Models for PPG-Based Health Assessment
Nell Hodgson Woodruff School of Nursing(Nell Hodgson Woodruff护理学院);School of Computer Science(计算机科学学院);Department of Pediatrics(儿科系);Department of Computer Science(计算机科学系);Department of Epidemiology(流行病学系);Department of Anesthesiology(麻醉学系);Department of Surgery(外科系);Department of Medicine(医学系);School of Medicine(医学院)
Estimating Clinical Lab Test Result Trajectories from PPG using Physiological Foundation Model and Patient-Aware State Space Model -- a UNIPHY+ Approach
School of Nursing, Emory University(埃默里大学护理学院);NKDHS, Inc(NKDHS公司);Emory Healthcare(埃默里医疗集团);UCSF(加州大学旧金山分校)
Towards Benchmarking Foundation Models for Tabular Data With Text
Department of Computer Science, University of Freiburg, Freiburg, Germany(弗赖堡大学计算机科学系);Prior Labs, Freiburg, Germany(Prior实验室);ELLIS Institute, Tubingen, Germany(图宾根ELLIS研究所)
Machine-learning for photoplethysmography analysis: Benchmarking feature, image, and signal-based approaches
Carl von Ossietzky Universität Oldenburg(奥尔登堡卡尔·冯·奥西特齐大学);Laboratoire national de métrologie et d’essais(国家计量与测试实验室);Biomedical Engineering Institute, Kaunas University of Technology(克莱萨斯理工大学生物医学工程研究所);Physikalisch-Technische Bundesanstalt(德国物理技术部);National Physical Laboratory(国家物理实验室);King’s College London(伦敦国王学院);University of Surrey(萨里大学);Department of Public Health and Primary Care, University of Cambridge(剑桥大学公共卫生与初级保健系)
AdaBrain-Bench: Benchmarking Brain Foundation Models for Brain-Computer Interface Applications
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);The Chinese University of Hong Kong(香港中文大学);Tsinghua University(清华大学);North China Electric Power University(华北电力大学)
OmniEEG-Bench: A Standardized Evaluation Benchmark for EEG Foundation Models
Department of Biomedical Engineering, Southern University of Science and Technology, Shenzhen, China(南方科技大学生物医学工程系,深圳,中国);School of Computer Science and Engineering, The Chinese University of Hong Kong, Shenzhen, China(香港中文大学(深圳)计算机科学与工程学院,深圳,中国);Omni-Intelligence, Shenzhen, China(奥米智能,深圳,中国);Shenzhen Loop Area Institute, Shenzhen, China(深圳环城研究院,深圳,中国)
Biosignal Fingerprinting: A Cross-Modal PPG-ECG Foundation Model
Department of Engineering Science, University of Oxford(牛津大学工程科学系);Oxford Suzhou Centre for Advanced Research(牛津苏浙先进研究中心);School of Public Health, Shanghai Jiao Tong University(上海交通大学公共卫生学院)
Tabular foundation model for GEOAI benchmark problems BM/AirportSoilProperties/2/2025
Department of Civil and Environmental Engineering, Tohoku University(土屋大学土木环境工程系);Research Organization of Information and Systems, The Institute of Statistical Mathematics(信息与系统研究所,统计数学研究所);The Graduate University for Advanced Studies, Department of Statistical Science(高级研究大学,统计科学系)
Multimodal Clinical Benchmark for Emergency Care (MC-BEC): A Comprehensive Benchmark for Evaluating Foundation Models in Emergency Medicine
Harvard Medical School(哈佛医学院);Stanford University(斯坦福大学);Harvard John A. Paulson School of Engineering and Applied Sciences, Harvard University(哈佛大学约翰·A·保尔森工程与应用科学学院)
Mars-Bench: A Benchmark for Evaluating Foundation Models for Mars Science Tasks
School of Computing and Augmented Intelligence, Arizona State University(计算与增强智能学院,亚利桑那州立大学);School of Earth and Space Exploration, Arizona State University(地球与空间探索学院,亚利桑那州立大学);Jet Propulsion Laboratory, California Institute of Technology(喷气推进实验室,加州理工学院)
GEO-Bench: Toward Foundation Models for Earth Monitoring
ServiceNow Research(ServiceNow研究院);Technical University of Munich(慕尼黑工业大学);Stanford University(斯坦福大学);Arizona State University(亚利桑那州立大学);MIT(麻省理工学院);ETH Zurich(苏黎世联邦理工学院);Clark University(克拉克大学);Mila-Quebec(魁北克人工智能研究所);University of Montreal(蒙特利尔大学)
UltraBench 2: Towards Robust Evaluation of Vision Foundation Models on Ultrasound
University of California, Los Angeles(加州大学洛杉矶分校);Université Laval(拉瓦尔大学);Mila – Quebec AI Institute(米拉-魁北克人工智能研究所);UCLA David Geffen School of Medicine(加州大学洛杉矶分校大卫·格芬医学院)
OpenECG: Benchmarking ECG Foundation Models with Public 1.2 Million Records
The First Affiliated Hospital, Jiangxi Medical College, Nanchang University(南昌大学江西医学院第一附属医院);Nanchang University(南昌大学);Georgia Institution of Technology(佐治亚理工学院)
Benchmarking Foundation Models with Multimodal Public Electronic Health Records
Centre for Quantitative Medicine and Duke-NUS AI + Medical Science Initiative, Duke-NUS Medical School(定量医学中心和杜克-国立新加坡大学AI+医学科学计划,杜克-国立新加坡大学医学院);Graduate School of Engineering, The University of Tokyo(东京大学工程研究生院);Department of Population Health Sciences, Weill Cornell Medicine(流行病学与公共卫生科学系,韦尔·科恩医学中心);Department of Surgery, Duke University School of Medicine(外科医学系,杜克大学医学学院);Centre for Quantitative Medicine, Duke-NUS AI + Medical Science Initiative and Programme in Health Services and Systems Research, Duke-NUS Medical School and NUS Artificial Intelligence Institute, National University of Singapore(定量医学中心和杜克-国立新加坡大学AI+医学科学计划及健康服务与系统研究计划,杜克-国立新加坡大学医学院和新加坡国立大学人工智能研究所)
BioMap Research(BioMap研究部);AI Lab, Research Center for Industries of the Future(人工智能实验室,未来产业研究中心);Westlake University(西湖大学);University of Chinese Academy of Sciences, China(中国科学院大学)
Rethinking Foundation Models for Medical Image Classification through a Benchmark Study on MedMNIST
University of Oxford(牛津大学);Nuffield Department of Population Health, University of Oxford(牛津大学纳菲尔德人口健康系);Big Data Institute, University of Oxford(牛津大学大数据研究所)
Benchmarking Tabular Foundation Models for Conditional Density Estimation in Regression
Department of Statistics, Federal University of São Carlos (UFSCar)(圣卡洛斯联邦大学统计系);Univ. Grenoble Alpes, Inria, CNRS, Grenoble INP, LJK(格勒诺布尔阿尔卑斯大学、法国国家信息与自动化研究所、法国国家科学研究中心、格勒诺布尔国立理工学院、让·库尔坦数学实验室)
A Systematic Survey and Benchmark of Deep Learning for Molecular Property Prediction in the Foundation Model Era
The University of Hong Kong, Hong Kong SAR(香港大学);Nanyang Technological University, Singapore(南洋理工大学);University of Cambridge, United Kingdom(剑桥大学);Zhejiang Normal University, China(浙江师范大学);The Hong Kong University of Science and Technology, Hong Kong SAR(香港科学与技术大学);The University of Queensland(昆士兰大学);The Hong Kong Polytechnic University, Hong Kong SAR(香港理工大学)
Navigating Data Scarcity using Foundation Models: A Benchmark of Few-Shot and Zero-Shot Learning Approaches in Medical Imaging
Cluster of Excellence “Machine Learning”(卓越集群“机器学习”);University of Tübingen(蒂宾根大学);Faculty of Health Sciences and Medicine, University of Lucerne(卢塞恩大学健康科学与医学院)