Dementia affects millions of older adults worldwide, yet early detection remains difficult outside clinical settings. Traditional models primarily rely on text or voice-based responses, capturing only a limited view of human cognition despite the inherently multimodal nature of human expression. This work proposes a contactless, multimodal screening framework that leverages video, audio, and text signals collected during structured voice-based interactions with Amazon Alexa. By incorporating these modalities, our approach captures a more holistic representation of human behavior encompassing speech patterns, vocal characteristics, facial expressions, and linguistic structure, which may enable more accurate detection of cognitive decline. Different participants completed three conversational tasks designed to probe spontaneous speech, comprehension, and recall. We pursued three objectives: (1) evaluate which of the three Alexa tasks provides the most informative cognitive signals, (2) compare the effectiveness of unimodal models, and (3) assess the benefits of multimodal fusion models. Task-level analysis shows that the video model achieves its best performance on Command-Reading, with an accuracy of 0.65 (AUC 0.69), while the audio model performs best on Question-Answering, reaching an accuracy of 0.67 (AUC 0.73). In contrast, the multimodal model demonstrates consistently stable performance across tasks, achieving an accuracy of 0.76 (AUC 0.75) on Command-Reading and 0.76 (AUC 0.73) on Question-Answering. These findings demonstrate that multimodal behavioral cues captured through naturalistic interactions can reliably distinguish MCI from healthy aging, highlighting the limitations of traditional diagnostic paradigms and supporting the shift toward multimodal, real-world cognitive assessment frameworks.
Linguistic-Based Mild Cognitive Impairment Detection Using Informative Loss
Ritchie School of Engineering and Computer Science(工程与计算机科学里奇学院);DreamFace Technologies LLC(DreamFace科技有限责任公司);Massachusetts General Hospital(麻省总医院);Prince Sattam Bin Abdulaziz University(萨塔姆·本·阿卜杜勒阿齐兹王子大学)
Predicting Mild Cognitive Impairment Using Naturalistic Driving and Trip Destination Modeling
Department of Mechanical Engineering, Iowa State University(爱荷华州立大学机械工程系);Institute for Transportation, Iowa State University(爱荷华州立大学交通研究所);Department of Neurological Sciences, University of Nebraska Medical Center(内布拉斯加医学院神经科学系)
PROCESS-2: A Benchmark Speech Corpus for Early Cognitive Impairment Detection
School of Computer Science, University of Sheffield(谢菲尔德大学计算机科学学院);Sheffield Institute for Translational Neuroscience (SITraN), University of Sheffield(谢菲尔德转化神经科学研究所)
Deep Learning-Based Detection of Cognitive Impairment from Passive Smartphone Sensing with Routine-Aware Augmentation and Demographic Personalization
Department of Electrical and Computer Engineering, Cockrell School of Engineering, The University of Texas at Austin(电气与计算机工程系,Cockrell工程学院,德克萨斯大学奥斯汀分校);Department of Neurology, Dell Medical School, The University of Texas at Austin(神经病学系,德克萨斯医学学院,德克萨斯大学奥斯汀分校);Department of Neurology, University of Texas Southwestern Medical Center(神经病学系,德克萨斯西南医学中心);Peter O’Donnell Jr. Brain Institute, University of Texas Southwestern Medical Center(彼得·奥·唐纳德·杰罗姆脑研究所,德克萨斯西南医学中心);Department of Speech, Language, and Hearing Sciences, Moody College of Communication, The University of Texas at Austin(语言病理学系,摩依学院,德克萨斯大学奥斯汀分校)
Unveil Multi-Picture Descriptions for Multilingual Mild Cognitive Impairment Detection via Contrastive Learning
Computer Science, University of Massachusetts, Boston, MA, USA(马萨诸塞大学计算机科学系,波士顿分校);Computer Science, University of Massachusetts, Lowell, MA, USA(马萨诸塞大学计算机科学系,洛厄尔分校)
A comprehensive interpretable machine learning framework for Mild Cognitive Impairment and Alzheimer's disease diagnosis
Faculty of Electrical and Computer Engineering, National Technical University of Athens(雅典国立技术大学电气与计算机工程学院);Center for Biomedical Image Computing and Analytics, University of Pennsylvania(宾夕法尼亚大学生物医学图像计算与分析中心)
Evaluating Spoken Language as a Biomarker for Automated Screening of Cognitive Impairment
Imperial College London(帝国理工学院);UK Dementia Research Institute(英国痴呆症研究所);Imperial College Healthcare NHS Trust(帝国理工学院医疗保健国民保健服务信托基金);University of Surrey(萨里大学);University of Southern California(南加州大学)
Deep Learning Approaches with Explainable AI for Differentiating Alzheimer Disease and Mild Cognitive Impairment
School of Mathematical and Natural Sciences(数学与自然科学学院);Arizona State University(亚利桑那州立大学);Department of Mathematics(数学系);Florida Gulf Coast University(佛罗里达海岸大学);Department of Public Health(公共卫生系);Julia Jones Matthews School of Population and Public Health(朱莉亚·琼斯·马修斯人口与公共卫生学院);Texas Tech University Health Sciences Center(德克萨斯农工大学健康科学中心)
A Machine Learning Approach for Identifying Anatomical Biomarkers of Early Mild Cognitive Impairment
Universiti Teknologi PETRONAS(国油科技大学);Hospital Universiti Sains Malaysia(马来西亚理科大学医院);Universiti Sains Malaysia(马来西亚理科大学);Ulster University(阿尔斯特大学);University of Calgary(卡尔加里大学);University of Bath(巴斯大学)
Multi-Scale Graph Theoretical Analysis of Resting-State fMRI for Classification of Alzheimer's Disease, Mild Cognitive Impairment, and Healthy Controls
University of Bojnord(博季努尔德大学);Munster Technological University(芒斯特理工大学)
Predicting Deterioration in Mild Cognitive Impairment with Survival Transformers, Extreme Gradient Boosting and Cox Proportional Hazard Modelling
Goldsmiths, University of London(伦敦大学金史密斯学院);School of Health Sciences, The University of Manchester(曼彻斯特大学健康科学学院);Faculty of Computer Science and Engineering, Frankfurt University of Applied Sciences(法兰克福应用科学大学计算机科学与工程学院);Institute of Psychiatry, Psychology and Neuroscience King’s College London(伦敦国王学院精神病学、心理学与神经科学研究所)
Toward Generalizable Cognitive Impairment Detection with Speech-Based Multimodal Large Language Models
Faculty of Digital Innovation, Arts \& Sciences, Saskatchewan Polytechnic, Regina SK S4S 5X1, Canada;School of Basic Medical Sciences, Hebei University, Baoding 071000, China;Department of Civil \& Environmental Engineering;School of Mining \& Petroleum Engineering, University of Alberta, Edmonton AB T6G 2H5, Canada
Linguistic and Audio Embedding-Based Machine Learning for Alzheimer's Dementia and Mild Cognitive Impairment Detection: Insights from the PROCESS Challenge
Singapore University of Technology and Design(新加坡科技设计大学);Hochschule für Musik Detmold(音乐学院Detmold)
Bias and Fairness in Self-Supervised Acoustic Representations for Cognitive Impairment Detection
Zentrum für Künstliche Intelligenz (KIZ), Technische Hochschule Nürnberg(人工智能中心(KIZ),图林根技术大学纽伦堡分校);Pattern Recognition Lab, Friedrich-Alexander Universität Erlangen-Nürnberg(模式识别实验室,弗赖堡-艾尔兰根-纽伦堡大学);GITA Lab, University of Antioquia(GITA实验室,安蒂奎亚大学)
DeepTokenEEG Enhancing Mild Cognitive Impairment and Alzheimers Classification via Tokenized EEG Features
Hanoi University of Science and Technology(河内科学与技术大学);VNU University of Engineering and Technology(越南工程与技术大学);Central Military Hospital 108(第108中心军医院);University of California, Irvine(加州大学尔湾分校)
Connected Speech-Based Cognitive Assessment in Chinese and English
Usher Institute, Medical School(医学院厄舍研究所);School of Health in Social Science(社会科学健康学院);School of Engineering, University of Edinburgh(爱丁堡大学工程学院);Carnegie Mellon University(卡内基梅隆大学);University of Delaware(特拉华大学);Cardinal Tien Hospital(圣保禄医院)
Machine-Learning Assessment of the Predictive Value of Inflammatory Biomarkers for Cognitive Impairment in an Older Hispanic Adult Cohort
Worcester Polytechnic Institute(伍斯特理工学院);Centro de Vacunación e Investigación (CEVAXIN)(疫苗接种与研究中心(CEVAXIN));Universidad Tecnológica de Panamá(巴拿马理工大学);Instituto de Investigaciones Científicas y Servicios de Alta Tecnología (INDICASAT AIP)(高科技科学研究与服务研究所(INDICASAT AIP));Secretaría Nacional de Ciencia, Tecnología e Innovación (SENACYT)(国家科学、技术与创新秘书处(SENACYT));Universidad Católica Santa María La Antigua(圣玛丽亚拉安提瓜天主教大学)
A Pilot Study on Visually Stimulated Cognitive Tasks for EEG-Based Dementia Recognition
Korea Advanced Institute of Science and Technology (KAIST)(韩国科学技术院);Faculty of Medicine Siriraj Hospital, Mahidol University(玛希隆大学诗里拉吉医学院);Neurocognitive Disorders & Neural Computing Research Group(神经认知障碍与神经计算研究组)