Events are fundamental for understanding how people experience their lives. It is challenging, however, to automatically record all events in daily life. An understanding of multimedia signals allows recognizing events of daily living and getting their attributes as automatically as possible. In this paper, we consider the problem of recognizing a daily event by employing the commonly used multimedia data obtained from a smartphone and wearable device. We develop an unobtrusive approach to obtain latent semantic information from the data, and therefore an approach for daily event recognition based on semantic context enrichment. We represent the enrichment process through an event knowledge graph that semantically enriches a daily event from a low-level daily activity. To show a concrete example of this enrichment, we perform an experiment with eating activity, which may be one of the most complex events, by using 14 months of data for three users. In this process, to unobtrusively complement the lack of semantic information, we suggest a new food recognition/classification method that focuses only on a physical response to food consumption. Experimental results indicate that our approach is able to show automatic abstraction of life experience. These daily events can then be used to create a personal model that can capture how a person reacts to different stimuli under specific conditions.
On-Demand Myoelectric Control Using Wake Gestures to Eliminate False Activations During Activities of Daily Living
Department of Electrical Engineering, University of New Brunswick(新不伦瑞克大学电气工程学院);HCI and SPECTRAL Labs, University of New Brunswick(新不伦瑞克大学HCI与SPECTRAL实验室)
Detecting Activities of Daily Living in Egocentric Video to Contextualize Hand Use at Home in Outpatient Neurorehabilitation Settings
Institute of Biomedical Engineering, University of Toronto(多伦多大学生物医学工程研究所);KITE - Toronto Rehabilitation Institute, University Health Network(大学健康网络KITE-多伦多康复研究所);Rehabilitation Sciences Institute, University of Toronto(多伦多大学康复科学研究所);Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto(多伦多大学爱德华·S·罗杰斯 Sr. 电气与计算机工程系)
Sound-first immersive training for blind and low-vision learners: A simulation flow for safe, standardized orientation, mobility, and daily living practice
An Interactive LLM-Based Simulator for Dementia-Related Activities of Daily Living
Worcester Polytechnic Institute(伍斯特理工学院);University of California Davis(加州大学戴维斯分校);MGH Institute of Health Professionals(麻省总医院健康专业学院);University of New Hampshire(新罕布什尔大学)
Multi-Modal Data Collection for Measuring Health, Behavior, and Living Environment of Large-Scale Participant Cohorts: Conceptual Framework and Findings from Deployments
From Pen Strokes to Sleep States: Detecting Low-Recovery Days Using Sigma-Lognormal Handwriting Features
Osaka Metropolitan University(大阪公立大学);University of Applied Sciences and Arts Western Switzerland(瑞士西部应用科学与艺术大学);University of Fribourg(弗里堡大学);German Research Center for Artificial Intelligence, Japan Laboratory(德国人工智能研究中心日本实验室)