Magnitude and Rotation Invariant Detection of Transportation Modes with Missing Data Modalities
IDLab, Ghent University-imec(IDLab,根特大学-imec);Institute for Clarity in Documentation(文档清晰度研究所);Inria Paris-Rocquencourt(法国国家信息与自动化研究所巴黎-罗康分所);Rajiv Gandhi University(拉吉夫·甘地大学);Tsinghua University(清华大学);Palmer Research Laboratories(帕尔默研究实验室)
Jeroen Van Der Donckt, Jonas Van Der Donckt, Sofie Van Hoecke
备注:
Accepted at HASCA workshop - SHL challenge (UbiComp 2024)
This work presents the solution of the Signal Sleuths team for the 2024 SHL recognition challenge. The challenge involves detecting transportation modes using shuffled, non-overlapping 5-second windows of phone movement data, with exactly one of the three available modalities (accelerometer, gyroscope, magnetometer) randomly missing. Data analysis indicated a significant distribution shift between train and validation data, necessitating a magnitude and rotation-invariant approach. We utilize traditional machine learning, focusing on robust processing, feature extraction, and rotation-invariant aggregation. An ablation study showed that relying solely on the frequently used signal magnitude vector results in the poorest performance. Conversely, our proposed rotation-invariant aggregation demonstrated substantial improvement over using rotation-aware features, while also reducing the feature vector length. Moreover, z-normalization proved crucial for creating robust spectral features.
ICYM2I: The illusion of multimodal informativeness under missingness
Department of Biomedical Informatics, Columbia University(生物医学信息学系,哥伦比亚大学);Seymour, Paul, and Gloria Milstein Division of Cardiology, Department of Medicine, Columbia University Irving Medical Center(塞缪尔、保罗和格洛丽亚米尔斯坦心脏病科,哥伦比亚大学伊万格琳医学中心)
IMAN: An Adaptive Network for Robust NPC Mortality Prediction with Missing Modalities
School of Computer Science and Technology, Guangdong University of Technology(广东工业大学计算机科学与技术学院);Faculty of Applied Sciences, Macao Polytechnic University(澳门理工大学应用科学学院);School of Information Science and Technology, Guangdong University of Foreign Studies(广东外语外贸大学信息科学与技术学院);Department of Computer and Information Science, University of Macau(澳门大学计算机与信息科学系);School of Computer Science and Engineering, Huizhou University(惠州大学计算机科学与工程学院)
Co-Learning for Missing Arbitrary Modalities in Multi-modal Classification
GFZ Helmholtz Center for Geosciences(德国波茨坦地学研究中心亥姆霍兹中心);INRAE, UMR TETIS, University of Montpellier(法国蒙彼利埃大学农业环境与生态研究院、蒙彼利埃大学TETIS联合研究单位);INRIA, EVERGREEN, University of Montpellier(法国蒙彼利埃大学信息与自动化研究所、EVERGREEN实验室);CIRAD, UMR TETIS, University of Montpellier(法国蒙彼利埃大学国际农业研究磋商组织、蒙彼利埃大学TETIS联合研究单位)
Addressing Missing and Noisy Modalities in One Solution: Unified Modality-Quality Framework for Low-quality Multimodal Data
Department of Computer Science(计算机科学系);South China Normal University(华南师范大学);School of Electronics and Information Technology(电子与信息学院);Sun Yat-sen University(中山大学)
Embracing Aleatoric Uncertainty in Medical Multimodal Learning with Missing Modalities
HKUST (GZ)(香港科技大学);Tongji University(同济大学);University of Rochester(罗切斯特大学);Meta;Fudan University(复旦大学);The University of British Columbia(不列颠哥伦比亚大学);University of California, Davis(加州大学戴维斯分校)
PRIME: Prototype-Driven Multimodal Pretraining for Cancer Prognosis with Missing Modalities
University of Minnesota(明尼苏达大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);North Carolina State University(北卡罗来纳州立大学);National University of Singapore(新加坡国立大学);Institute of High Performance Computing, Agency for Science, Technology and Research(高性能计算研究所,新加坡科技研究局)
Causal Debiasing Medical Multimodal Representation Learning with Missing Modalities
DataLab: Data Science and Informatics, University of California, Davis(加州大学戴维斯分校数据实验室);Department of Electrical and Computer Engineering, University of Rochester(罗切斯特大学电气与计算机工程系);Academy for Engineering & Technology, Fudan University(复旦大学工程与技术学院);Department of Computer Science, University of Toronto(多伦多大学计算机科学系);Department of Electrical and Computer Engineering, New York University(纽约大学电气与计算机工程系);UC Davis Health(加州大学戴维斯分校医疗中心);Department of Basic Medical Sciences, University of Arizona(亚利桑那大学基础医学系);Department of Computer Science, University of California, Davis(加州大学戴维斯分校计算机科学系)
Brain tumor segmentation with missing modalities via latent multi-source correlation representation
Normandie Univ, INSA Rouen, UNIROUEN, UNIHAVRE, LITIS(诺曼底大学,鲁昂国立应用科学学院,鲁昂大学,勒阿弗尔大学,LITIS);Department of Nuclear Medicine, Henri Becquerel Cancer Center(亨利·贝克勒尔癌症中心核医学科)
Calibrated Multimodal Representation Learning with Missing Modalities
National University of Singapore(国立新加坡大学);University of Science and Technology of China(中国科学技术大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Central South University(中南大学)
Multimodal Federated Learning With Missing Modalities through Feature Imputation Network
University of Aberdeen(阿伯丁大学);NepAl Applied Mathematics and Informatics Institute for research(尼泊尔应用数学与信息技术研究所);West Virginia University(西弗吉尼亚大学);Fogsphere (Redev.AI)(Fogsphere(Redev.AI))
Cross-Modal Prototype based Multimodal Federated Learning under Severely Missing Modality
Kyung Hee University(庆熙大学);The University of Danang—Vietnam-Korea University of Information and Communication Technology(岘港大学—越韩信息与通信技术大学);Digital Science and Technology Institute(数字科学技术研究院)
Deep Multimodal Learning with Missing Modality: A Survey
The Australian National University(澳大利亚国立大学);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Adelaide University(阿德莱德大学);The University of Surrey(萨里大学)
Multimodal Sentiment Analysis with Missing Modality: A Knowledge-Transfer Approach
College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算机与数据科学学院);Singapore University of Social Sciences, Singapore(新加坡社会科学研究大学)
Dynamical modeling of nonlinear latent factors in multiscale neural activity with real-time inference
Department of Electrical and Computer Engineering(电气与计算机工程系);University of Southern California(南加州大学);Department of Computer Science(计算机科学系);Department of Biomedical Engineering(生物医学工程系);Neuroscience Graduate Program(神经科学研究生项目)