Vision-Language Intelligence: Tasks, Representation Learning, and Large Models
The Hong Kong University of Science and Technology（香港科技大学）；Chinese Academy of Science（中国科学院）；International Digital Economy Academy (IDEA)（国际数字经济研究院）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Microsoft Research（微软研究院）；Tsinghua University（清华大学）
Feng Li, Hao Zhang, Yi-Fan Zhang, Shilong Liu, Jian Guo, Lionel M. Ni, PengChuan Zhang, Lei Zhang
This paper presents a comprehensive survey of vision-language (VL) intelligence from the perspective of time. This survey is inspired by the remarkable progress in both computer vision and natural language processing, and recent trends shifting from single modality processing to multiple modality comprehension. We summarize the development in this field into three time periods, namely task-specific methods, vision-language pre-training (VLP) methods, and larger models empowered by large-scale weakly-labeled data. We first take some common VL tasks as examples to introduce the development of task-specific methods. Then we focus on VLP methods and comprehensively review key components of the model structures and training methods. After that, we show how recent work utilizes large-scale raw image-text data to learn language-aligned visual representations that generalize better on zero or few shot learning tasks. Finally, we discuss some potential future trends towards modality cooperation, unified representation, and knowledge incorporation. We believe that this review will be of help for researchers and practitioners of AI and ML, especially those interested in computer vision and natural language processing.
A Picture is Worth a Collaboration: Accumulating Design Knowledge for Computer-Vision-based Hybrid Intelligence Systems
Friedrich-Alexander-Universität Erlangen-Nürnberg（埃尔朗根-纽伦堡大学）；Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；Ceratizit Austria GmbH（奥地利森拉天时有限公司）；Otto-von-Guericke-Universität Magdeburg（奥托·冯·格里克马格德堡大学）；IBM（国际商业机器公司）
OmniFashion: Towards Generalist Fashion Intelligence via Multi-Task Vision-Language Learning
National Engineering Research Center for Multimedia Software, Institute of Artificial Intelligence, School of Computer Science, Wuhan University（国家多媒体软件工程技术研究中心、人工智能研究院、计算机科学学院、武汉大学）；Harbin Institute of Technology（哈尔滨工业大学）
Concurrent validity of computer-vision artificial intelligence player tracking software using broadcast footage
Australian Catholic University（澳大利亚天主教大学）；Leeds Beckett University（利兹贝克特大学）；Fédération Internationale de Football Association (FIFA)（国际足球联合会（FIFA））；Sheffield Hallam University（谢菲尔德哈勒姆大学）；Victoria University（维多利亚大学）
LangXAI: Integrating Large Vision Models for Generating Textual Explanations to Enhance Explainability in Visual Perception Tasks
University of New Brunswick（新不伦瑞克大学）；Quy Nhon AI, FPT Software（FPT软件公司归仁人工智能部门）；Friedrich-Alexander-University Erlangen-Nürnberg（埃尔朗根-纽伦堡弗里德里希-亚历山大大学）；Software AG（软件AG公司）
LangXAI 框架将 XAI 与先进视觉模型结合，为分类、检测和分割任务生成文本解释，以高 BERTScore 验证其合理性，从而提升终端用户对视觉 AI 的理解与信任。
From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models
School of Computer Science, Sichuan University（四川大学计算机学院）；School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School（北京大学深圳研究生院电子与计算机工程学院）；Institute of Artificial Intelligence (TeleAI), China Telecom and Northwestern Polytechnical University（中国电信与西北工业大学人工智能研究院（TeleAI））
VisionFM: a Multi-Modal Multi-Task Vision Foundation Model for Generalist Ophthalmic Artificial Intelligence
The Chinese University of Hong Kong（香港中文大学）；Beijing Tongren Eye Center（北京同仁眼科中心）；Beijing Tongren Hospital（北京同仁医院）；Capital Medical University（首都医科大学）；King’s College London（伦敦国王学院）；Intelligent Vision Plus Technology Co., Ltd.（智影加科技有限公司）；Peking University Health Science Center（北京大学医学部）；SightAI Technology Pte. Ltd.（SightAI科技私人有限公司）；Handan City Eye Hospital（邯郸市眼科医院）；First Affiliated Hospital of Xi’an Jiaotong University（西安交通大学第一附属医院）；Chengdu University of Traditional Chinese Medicine（成都中医药大学）；Eye Center of Xiangya Hospital, Central South University（中南大学湘雅医院眼科中心）；Shanxi Eye Hospital Affiliated to Shanxi Medical University（山西医科大学附属眼科医院）；Precision Robotics (Hong Kong) Co., Ltd.（精密机器人（香港）有限公司）；Imperial College London（帝国理工学院）；Yong Loo Lin School of Medicine, National University of Singapore（新加坡国立大学杨潞龄医学院）；Tsinghua University（清华大学）；Beijing Tsinghua Changgang Hospital（北京清华长庚医院）；Singapore Eye Research Institute（新加坡眼科研究所）；Singapore National Eye Centre（新加坡国家眼科中心）
GDI-Bench: A Benchmark for General Document Intelligence with Vision and Reasoning Decoupling
Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）；Zhejiang University（浙江大学）；School of Science and Engineering, The Chinese University of Hong Kong（香港中文大学科学与工程学院）；Fudan University（复旦大学）；Shanghai Innovation Institute（上海创新研究院）
Swarm Intelligence in Geo-Localization: A Multi-Agent Large Vision-Language Model Collaborative Framework
City University of Hong Kong（香港城市大学）；University of Science and Technology of China（中国科学技术大学）；Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））
Artificial Intelligence for Sustainability: Facilitating Sustainable Smart Product-Service Systems with Computer Vision
Karlsruhe Institute of Technology（卡尔斯鲁厄理工学院）；University of Bayreuth（拜罗伊特大学）；University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）；Plansee SE（攀时股份公司）
xAI-CV: An Overview of Explainable Artificial Intelligence in Computer Vision
Faculty of Information Technology, University of Science, Ho Chi Minh City, Vietnam（信息科技学院，科学大学，胡志明市，越南）；Vietnam National University, Ho Chi Minh City, Vietnam（越南国家大学，胡志明市，越南）
EchoVLM: Dynamic Mixture-of-Experts Vision-Language Model for Universal Ultrasound Intelligence
School of iOPEN, Northwestern Polytechnical University（iOPEN学院，西北工业大学）；The First Affiliated Hospital of Sun Yat-Sen University（中山大学附属第一医院）；College of Mechanical Engineering, Tongji University（同济大学机械工程学院）
National Institute of Advanced Industrial Science and Technology (AIST)（日本国立先进工业科学技术研究所（AIST））；Visual Geometry Group (VGG), University of Oxford（牛津大学视觉几何组（VGG））；CADDi（CADDi公司）；OpenAI（OpenAI公司）；University of Cambridge（剑桥大学）；University of Technology Nuremberg（纽伦堡工业大学）；University of Tsukuba（筑波大学）；Google DeepMind（谷歌DeepMind）；Carnegie Mellon University（卡内基梅隆大学）；New York University（纽约大学）；Imperial College London（伦敦帝国学院）；Harvard University（哈佛大学）；Stanford University（斯坦福大学）；Princeton University（普林斯顿大学）
SurgVLM: A Large Vision-Language Model and Systematic Evaluation Benchmark for Surgical Intelligence
National University of Singapore（新加坡国立大学）；Nanyang Technological University（南洋理工大学）；University of Oxford（牛津大学）；State Key Laboratory of General Artificial Intelligence, BIGAI（通用人工智能国家重点实验室，BIGAI）；Shanghai Jiao Tong University（上海交通大学）；Sun Yat-sen University（中山大学）；The Chinese University of Hong Kong（香港中文大学）
