Multimodal classification research has been gaining popularity in many domains that collect more data from multiple sources including satellite imagery, biometrics, and medicine. However, the lack of consistent terminology and architectural descriptions makes it difficult to compare different existing solutions. We address these challenges by proposing a new taxonomy for describing such systems based on trends found in recent publications on multimodal classification. Many of the most difficult aspects of unimodal classification have not yet been fully addressed for multimodal datasets including big data, class imbalance, and instance level difficulty. We also provide a discussion of these challenges and future directions.
Survey of Large Multimodal Model Datasets, Application Categories and Taxonomy
University of Washington(华盛顿大学);New York University(纽约大学);Columbia University(哥伦比亚大学);Liverpool John Moores University(利物浦约翰摩尔大学);Chennai Mathematical Institute(金奈数学研究所);Birla Institute of Technology(比拉理工学院)
Exploring the Landscape of Machine Unlearning: A Comprehensive Survey and Taxonomy
University of Southern Queensland(南昆士兰大学);Lingnan University(岭南大学);Wuhan University of Technology(武汉理工大学);University of Electronic Science and Technology of China(电子科技大学);Hong Kong Polytechnic University(香港理工大学)
本文系统综述机器遗忘的最新方法、指标、数据集与挑战,并指出其在隐私、安全、公平及可信 AI 中的未来方向。
Radiology's Last Exam (RadLE): Benchmarking Frontier Multimodal AI Against Human Experts and a Taxonomy of Visual Reasoning Errors in Radiology
Centre for Responsible Autonomous Systems in Healthcare (CRASH) Lab, Koita Centre for Digital Health(负责任的自主医疗系统中心(CRASH)实验室、Koita数字健康中心);Ashoka University(阿什oka大学);Independent Researcher(独立研究者);Koita Centre for Digital Health(Koita数字健康中心)
OmniOpt: Taxonomy, Geometry, and Benchmarking of Modern Optimizers
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Shanghai University(上海大学);Westlake University(西湖大学);Shanghai Jiao Tong University(上海交通大学);UCAS(中国科学技术大学);Zhejiang University(浙江大学);Southern University of Science and Technology(南方科技大学)
A New Dataset and Benchmark for Grounding Multimodal Misinformation
National Engineering Research Center for Multimedia Software, School of Computer Science, Wuhan University(多媒体软件国家工程研究中心,计算机科学学院,武汉大学);School of Computing, National University of Singapore(计算学院,新加坡国立大学);School of Computer Science, Peking University(计算机科学学院,北京大学);State Key Laboratory for Multimedia Information Processing, Peking University(多媒体信息处理国家重点实验室,北京大学)
Navigating the landscape of multimodal AI in medicine: a scoping review on technical challenges and clinical applications
Radboud University Medical Center(拉德堡德大学医学中心);Oncode Institute(Oncode研究所);Polytechnic University of Turin(都灵理工大学);University of Turin(都灵大学);Erasmus University Medical Centre(伊拉斯姆斯大学医学中心)
Multimodal Fusion on Low-quality Data: A Comprehensive Survey
College of Intelligence and Computing, Tianjin University(天津大学智能与计算学部);Institute of High Performance Computing (IHPC), Agency for Science, Technology and Research (A*STAR)(新加坡科技研究局高性能计算研究所);Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);College of Computer Science, Sichuan University(四川大学计算机学院);School of Computer Science and Technology, Xidian University(西安电子科技大学计算机科学与技术学院);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院)
Evaluating GPT-5 as a Multimodal Clinical Reasoner: A Landscape Commentary
Department of Radiation Oncology, Winship Cancer Institute, Emory University School of Medicine(放射肿瘤科,Winship癌症研究所,埃默里大学医学院);Department of Biomedical Engineering, Georgia Institute of Technology(生物医学工程系,佐治亚理工学院)
Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
Peking University(北京大学);Beihang Univerisy(北京航空航天大学);University of Hongkong(香港大学);Shenzhen Institute of Advanced Technology, China Academy of Sciences(中国科学院深圳先进技术研究院);Tsinghua University(清华大学);M-A-P;The Chinese University of Hong Kong(香港中文大学);Alibaba Group(阿里巴巴集团);University of Cambridge(剑桥大学);Microsoft Research(微软研究院);UIUC(伊利诺伊大学厄巴纳-香槟分校);Humanify Inc.(Humanify公司);Zhejiang University(浙江大学)
Planning for Cooler Cities: A Multimodal AI Framework for Predicting and Mitigating Urban Heat Stress through Urban Landscape Transformation
Department of City and Regional Planning, University of Pennsylvania(城市与区域规划系,宾夕法尼亚大学);Guangdong Key Laboratory for Urban Informatics, Guangdong-Hong Kong-Macao Joint Laboratory for Smart Cities(广东城市信息关键实验室、粤港澳大湾区智慧城市联合实验室);Shenzhen Key Laboratory of Spatial Information Smart Sensing(深圳空间信息智能感知关键实验室);Department of Urban Informatics, School of Architecture and Urban Planning, Shenzhen University(城市信息系,深圳大学);College of Big Data and Internet, Shenzhen Technology University(大数据与互联网学院,深圳科技大学)
Machine Unlearning: Taxonomy, Metrics, Applications, Challenges, and Prospects
Nanjing University of Science and Technology(南京理工大学);Xidian University(西安电子科技大学);CSIRO(联邦科学与工业研究组织);University of Western Australia(西澳大学);University of Technology Sydney(悉尼科技大学)