Applications like personal assistants need to be aware ofthe user's context, e.g., where they are, what they are doing, and with whom. Context information is usually inferred from sensor data, like GPS sensors and accelerometers on the user's smartphone. This prediction task is known as context recognition. A well-defined context model is fundamental for successful recognition. Existing models, however, have two major limitations. First, they focus on few aspects, like location or activity, meaning that recognition methods based onthem can only compute and leverage few inter-aspect correlations. Second, existing models typically assume that context is objective, whereas in most applications context is best viewed from the user's perspective. Neglecting these factors limits the usefulness of the context model and hinders recognition. We present a novel ontological context model that captures five dimensions, namely time, location, activity, social relations and object. Moreover, our model defines three levels of description(objective context, machine context and subjective context) that naturally support subjective annotations and reasoning.An initial context recognition experiment on real-world data hints at the promise of our model.
Multi-modal Auto-regressive Modeling via Visual Words
School of Computer Science, Wuhan University(武汉大学计算机学院);Shanghai Jiao Tong University(上海交通大学);School of Information Management, Wuhan University(武汉大学信息管理学院)
GAMED: Knowledge Adaptive Multi-Experts Decoupling for Multimodal Fake News Detection
University of Southampton(南安普顿大学);University of Essex(埃塞克斯大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);The University of New South Wales(新南威尔士大学)
Modelling Visual Semantics via Image Captioning to extract Enhanced Multi-Level Cross-Modal Semantic Incongruity Representation with Attention for Multimodal Sarcasm Detection
Modelling Urban Dynamics with Multi-Modal Graph Convolutional Networks
University of Cambridge(剑桥大学);Univ Lyon, ENS de Lyon, UCB Lyon 1, CNRS, Laboratoire de Physique(里昂大学,里昂高等师范学校,里昂第一大学,法国国家科学研究中心,物理实验室);ENS de Lyon(里昂高等师范学校);New York University(纽约大学);Foursquare Labs(Foursquare实验室)
MMLNB: Multi-Modal Learning for Neuroblastoma Subtyping Classification Assisted with Textual Description Generation
Hangzhou Dianzi University(杭州电子科技大学);Tsinghua University(清华大学);National Clinical Research Center for Child Health, National Children's Regional Medical Center, Children's Hospital, Zhejiang University School of Medicine(浙江大学医学院附属儿童医院 国家儿童健康临床研究中心 国家儿童区域医疗中心);Sino-Finland Joint AI Laboratory for Child Health of Zhejiang Province(浙江省中芬儿童健康人工智能联合实验室)
A Tactical Behaviour Recognition Framework Based on Causal Multimodal Reasoning: A Study on Covert Audio-Video Analysis Combining GAN Structure Enhancement and Phonetic Accent Modelling
Dhurakij Pundit University(易三仓大学);The University of Western Australia(西澳大利亚大学);Association for Computing Machinery(美国计算机协会);Royal Anthropological Institute(英国皇家人类学学会)