A Survey of Current Datasets for Vision and Language Research
Microsoft Research(微软研究院);Johns Hopkins University(约翰霍普金斯大学);University of Rochester(罗切斯特大学);Carnegie Mellon University(卡内基梅隆大学)
Francis Ferraro, Nasrin Mostafazadeh, Ting-Hao, Huang, Lucy Vanderwende, Jacob Devlin, Michel Galley, Margaret Mitchell
备注:
To appear in EMNLP 2015, short proceedings. Dataset analysis and discussion expanded, including an initial examination into reporting bias for one of them. F.F. and N.M. contributed equally to this work
Integrating vision and language has long been a dream in work on artificial intelligence (AI). In the past two years, we have witnessed an explosion of work that brings together vision and language from images to videos and beyond. The available corpora have played a crucial role in advancing this area of research. In this paper, we propose a set of quality metrics for evaluating and analyzing the vision & language datasets and categorize them accordingly. Our analyses show that the most recent datasets have been using more complex language and more abstract concepts, however, there are different strengths and weaknesses in each.
Vision-Based Traffic Accident Detection and Anticipation: A Survey
Chang’an University(长安大学);National University of Singapore(新加坡国立大学);National Research University Moscow Power Engineering Institute(国立研究型大学莫斯科动力学院);Xi’an Jiaotong University(西安交通大学);Institute for Infocomm Research(资讯通信研究院)
A survey on Kornia: an Open Source Differentiable Computer Vision Library for PyTorch
Universitat Autònoma de Barcelona(巴塞罗那自治大学);Institut de Robòtica i Informàtica Industrial(工业机器人与信息技术研究所);Czech Technical University in Prague(布拉格捷克理工大学);The Chinese University of Hong Kong(香港中文大学)
Shanghai Jiao Tong University(上海交通大学);Music Tech Lab, DynamiX(音乐科技实验室,DynamiX);Shanghai AI Laboratory(上海人工智能实验室);Beijing Film Academy(北京电影学院);Tsinghua University(清华大学);McGill University(麦吉尔大学);The Chinese University of Hong Kong(香港中文大学)
Image Recognition with Online Lightweight Vision Transformer: A Survey
Beijing University of Posts and Telecommunications(北京邮电大学);State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences(多模态人工智能系统国家重点实验室,自动化研究所,中国科学院);Key Laboratory of Computing Power Network and Information Security, Ministry of Education, Shandong Computer Science Center, Qilu University of Technology, Shandong Provincial Key Laboratory of Computing Power Internet and Service Computing, Shandong Fundamental Research Center for Computer Science(计算能力网络与信息安全重点实验室,教育部,山东计算机科学中心,齐鲁大学,山东省计算能力互联网与服务计算重点实验室,山东省计算机科学基础研究中心)
Analysis of the hands in egocentric vision: A survey
KITE – Toronto Rehab – University Health Network(KITE – 多伦多康复 – 大学健康网络);Institute of Biomaterials and Biomedical Engineering (IBBME), University of Toronto(多伦多大学生物材料与生物医学工程研究所);Edward S. Rogers Sr. Department of Electrical and Computer Engineering, University of Toronto(多伦多大学爱德华·S·罗杰斯 Sr. 电气与计算机工程系);Rehabilitation Sciences Institute, University of Toronto(多伦多大学康复科学研究所)
Investigating Bi-Level Optimization for Learning and Vision from a Unified Perspective: A Survey and Beyond
Dalian University of Technology(大连理工大学);Southern University of Science and Technology(南方科技大学);Xi’an Jiaotong University(西安交通大学);Peking University(北京大学);Shanghai Jiao Tong University(上海交通大学)
From Structure to Synergy: A Survey of Vision-Language Perception Paradigm Evolution in Multimodal Large Language Models
School of Computer Science, Sichuan University(四川大学计算机学院);School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School(北京大学深圳研究生院电子与计算机工程学院);Institute of Artificial Intelligence (TeleAI), China Telecom and Northwestern Polytechnical University(中国电信与西北工业大学人工智能研究院(TeleAI))
NepAl Applied Mathematics and Informatics Institute for research (NAAMII)(尼泊尔应用数学与信息学研究所(NAAMII));Rochester Institute of Technology(罗切斯特理工学院);University of Aberdeen(阿伯丁大学)
The University of Hong Kong(香港大学);Tsinghua University(清华大学);Duke University(杜克大学);University of Rochester(罗切斯特大学);The Ohio State University(俄亥俄州立大学);Bytedance(字节跳动);The University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);Apple(苹果公司);The Hong Kong Polytechnic University(香港理工大学);Princeton University(普林斯顿大学)
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Small Vision-Language Models: A Survey on Compact Architectures and Techniques
School of Computer Engineering, Kalinga Institute of Industrial Technology (KIIT) Deemed to be University(卡林加工业技术学院(KIIT)德emed大学计算机工程学院);Indian Institute of Management Visakhapatnam(印度管理学院维沙卡帕特南分院);Remodel AI
Large Vision-Language Model Alignment and Misalignment: A Survey Through the Lens of Explainability
Northwestern University(西北大学);New Jersey Institute of Technology(新泽西理工学院);University of Bristol(布里斯托大学);Cisco Research(思科研究);University of Illinois Chicago(伊利诺伊大学芝加哥分校)
JailbreakZoo: Survey, Landscapes, and Horizons in Jailbreaking Large Language and Vision-Language Models
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Brown University(布朗大学);University of Michigan Ann Arbor(密歇根大学安娜堡分校);Hong Kong University of Science and Technology(香港科学与技术大学);Carnegie Mellon University(卡内基梅隆大学);Boise State University(博伊西州立大学)