Wearable sensors have become ubiquitous thanks to a variety of health tracking features. The resulting continuous and longitudinal measurements from everyday life generate large volumes of data; however, making sense of these observations for scientific and actionable insights is non-trivial. Inspired by the empirical success of generative modeling, where large neural networks learn powerful representations from vast amounts of text, image, video, or audio data, we investigate the scaling properties of sensor foundation models across compute, data, and model size. Using a dataset of up to 40 million hours of in-situ heart rate, heart rate variability, electrodermal activity, accelerometer, skin temperature, and altimeter per-minute data from over 165,000 people, we create LSM, a multimodal foundation model built on the largest wearable-signals dataset with the most extensive range of sensor modalities to date. Our results establish the scaling laws of LSM for tasks such as imputation, interpolation and extrapolation, both across time and sensor modalities. Moreover, we highlight how LSM enables sample-efficient downstream learning for tasks like exercise and activity recognition.
CogAdapt: Adapting Clinical ECG Foundation Models for Wearable Cognitive Load Assessment
Department of Computer Science, College of AI, Cyber and Computing, The University of Texas at San Antonio(计算机科学系,人工智能、网络与计算学院,德克萨斯大学圣安东尼奥分校);Department of Educational Psychology, College of Education and Human Development, The University of Texas at San Antonio(教育心理学系,教育与人类发展学院,德克萨斯大学圣安东尼奥分校)
A Foundation Model for Wearable Movement Data in Mental Health Research
Dartmouth College(达特茅斯学院);National Institute of Diabetes and Digestive and Kidney Diseases(国家糖尿病、消化系统疾病和肾病研究所);National Institutes of Health(美国国立卫生研究院);Department of Computer Science at Dartmouth College(达特茅斯学院计算机科学系)
Towards a General Intelligence and Interface for Wearable Health Data
Google Research(谷歌研究);Google DeepMind(谷歌DeepMind);University of Washington(华盛顿大学);University of Oregon(俄勒冈大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Toward Foundation Model for Multivariate Wearable Sensing of Physiological Signals
Halıcıoğlu Data Science Institute, University of California San Diego(哈利奇奥格鲁数据科学研究所,加州大学圣地亚哥分校);Schools of Engineering, Arizona State University(工程学院,亚利桑那州立大学)
PulseLM: A Foundation Dataset and Benchmark for PPG-Text Learning
Singapore Management University(新加坡管理大学);Queen Mary University of London(伦敦玛丽女王大学);Eindhoven University of Technology(埃因霍温理工大学);University of Cambridge(剑桥大学)
Wearable Foundation Models Should Go Beyond Static Encoders
Dartmouth College, USA(达特茅斯学院);University of Cambridge, UK(剑桥大学);The University of Melbourne, Australia(墨尔本大学);Google Research, UK(谷歌研究);Tsinghua University, China(清华大学)
Scaling laws in wearable human activity recognition
Google DeepMind(谷歌DeepMind);Google LLC School of Engineering & Informatics, University of Sussex, UK(谷歌 LLC 工程与信息学学院,Sussex 大学,英国);Google LLC Computer Laboratory, University of Cambridge, UK(谷歌 LLC 计算实验室,剑桥大学,英国);Google Research Queen’s University, Canada(谷歌研究 Queen’s 大学,加拿大)
FM-FoG: A Real-Time Foundation Model-based Wearable System for Freezing-of-Gait Mitigation
Department of Computer Science, William \& Mary Virginia USA;Department of Neurology, Virginia Commonwealth University Virginia USA;School of Nursing, Virginia Commonwealth University Virginia USA;Department of Computer Science, William \& Mary;Department of Neurology, Virginia Commonwealth University;School of Nursing, Virginia Commonwealth University
PPG-Distill: Efficient Photoplethysmography Signals Analysis via Foundation Model Distillation
Department of Computer Science, Emory University(计算机科学系,埃默里大学);Nell Hodgson Woodruff School of Nursing, Emory University(Nell Hodgson Woodruff护理学院,埃默里大学)
Emotion Recognition in Older Adults with Quantum Machine Learning and Wearable Sensors
Department of Electrical Engineering and Computer Science(电气工程与计算机科学系);University of Tennessee, Knoxville, TN, USA(田纳西大学,诺克斯维尔分校);Quantum Science Center, Oak Ridge National Laboratory, Oak Ridge, TN, USA(橡树岭国家实验室量子科学中心)
Biosignal Fingerprinting: A Cross-Modal PPG-ECG Foundation Model
Department of Engineering Science, University of Oxford(牛津大学工程科学系);Oxford Suzhou Centre for Advanced Research(牛津苏浙先进研究中心);School of Public Health, Shanghai Jiao Tong University(上海交通大学公共卫生学院)
Motion Capture is Not the Target Domain: Scaling Synthetic Data for Learning Motion Representations
Department of Statistics University of Oxford(统计系牛津大学);Big Data Institute University of Oxford(大数据研究所牛津大学);Nuffield Department of Population Health Big Data Institute University of Oxford(人口健康系大数据研究所牛津大学)
Towards Neural Scaling Laws for Time Series Foundation Models
Griffith University(格里菲斯大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));NVIDIA Research(英伟达研究院);The University of Tokyo(东京大学)